-- Logs begin at Tue 2022-06-28 16:57:18 UTC, end at Tue 2022-06-28 18:06:44 UTC. -- Jun 28 17:37:41.755060 dv-cinder-848013-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 17:37:41.763821 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 17:37:41 2022] *** Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: nodename: dv-cinder-848013-1-iscsi Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: machine: x86_64 Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: clock source: unix Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: pcre jit disabled Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: detected number of CPU cores: 4 Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: current working directory: / Jun 28 17:37:41.765670 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: detected binary path: /usr/bin/uwsgi-core Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: your processes number limit is 47680 Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: your memory page size is 4096 bytes Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: detected max file descriptor number: 2048 Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: lock engine: pthread robust mutexes Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: thunder lock: enabled Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 17:37:41.766204 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 17:37:41.809540 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: Python main interpreter initialized at 0x55da882309c0 Jun 28 17:37:41.809540 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: python threads support enabled Jun 28 17:37:41.809540 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: your server socket listen backlog is limited to 100 connections Jun 28 17:37:41.809540 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: your mercy for graceful operations on workers is 90 seconds Jun 28 17:37:41.809971 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 17:37:41.810053 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: *** Operational MODE: preforking *** Jun 28 17:37:41.810315 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: *** uWSGI is running in multiple interpreter mode *** Jun 28 17:37:41.810315 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: spawned uWSGI master process (pid: 109841) Jun 28 17:37:41.810542 dv-cinder-848013-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 17:37:41.811350 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: spawned uWSGI worker 1 (pid: 109842, cores: 1) Jun 28 17:37:41.811533 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: spawned uWSGI worker 2 (pid: 109843, cores: 1) Jun 28 17:37:41.811687 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 17:37:42.475169 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 17:37:42.477499 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 17:37:43.604369 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:37:43.604369 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: from cryptography.utils import int_from_bytes Jun 28 17:37:43.605503 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:37:43.605503 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: from cryptography.utils import int_from_bytes Jun 28 17:37:43.608950 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:37:43.608950 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: from cryptography.utils import int_from_bytes Jun 28 17:37:43.609602 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:37:43.609602 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: from cryptography.utils import int_from_bytes Jun 28 17:37:46.099822 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:37:46.100429 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:37:46.100645 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:37:46.101002 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:37:46.101261 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:37:46.101649 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.101975 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.102300 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.102620 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.102954 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.103281 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.103537 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:37:46.103951 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.104042 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:37:46.104115 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.104185 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.104421 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:37:46.104575 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.104680 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:37:46.104768 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.104941 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:37:46.105071 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-1-iscsi {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.105303 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.105405 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.105631 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.105776 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.105946 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106041 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106247 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106363 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106574 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106675 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106881 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.106985 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.107195 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.107293 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.107506 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.107689 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.107840 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.108905 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109020 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109098 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109180 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109251 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-1-iscsi {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109333 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109404 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109479 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109554 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109629 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109694 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109772 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.109981 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110077 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110203 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110300 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110611 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110811 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.110906 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111266 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-1-iscsi {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111362 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111589 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111680 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111887 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.111981 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.112197 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.112282 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.112553 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.112691 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.112972 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.113078 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.113304 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.113633 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.113833 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.113929 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114159 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114243 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114467 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114559 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114787 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.114888 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115093 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115179 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115472 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115573 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-1-iscsi {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115776 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.115868 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116087 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116172 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116421 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116535 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116735 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.116826 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117045 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117139 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117354 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117447 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117606 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117697 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117913 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.117999 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118238 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118346 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118559 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118664 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118883 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.118981 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119132 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119225 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119385 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119496 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119714 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.119805 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120036 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120128 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120343 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120500 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120682 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120782 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.120982 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121066 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121282 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121372 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121525 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121618 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121828 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.121918 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122143 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122227 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122464 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122559 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122781 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.122866 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123027 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123120 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123272 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123403 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123587 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123722 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.123900 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124046 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124206 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124468 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124567 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124723 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.124808 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125032 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125128 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125371 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125467 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125688 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125771 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.125987 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126072 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126380 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126606 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126700 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.126911 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127002 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127221 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127317 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127520 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127603 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127836 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.127921 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.128169 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.128252 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.128684 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.128990 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129100 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129292 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129378 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129601 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129692 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.129925 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130010 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130234 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130318 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130544 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130629 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130855 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.130946 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131161 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131297 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131463 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131548 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131768 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.131858 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132075 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132167 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132397 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132500 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132708 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132800 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.132956 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133048 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133257 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133349 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133562 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133652 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133879 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.133967 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134181 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134275 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134484 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134576 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134785 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.134869 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135084 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135176 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135390 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135481 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135698 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135821 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.135998 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136115 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136300 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136484 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136664 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136758 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.136927 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137028 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137230 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137329 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137530 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137621 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137827 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.137920 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138140 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138273 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138445 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138535 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138743 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.138834 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139046 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139175 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139346 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139450 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139646 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139742 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.139953 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140038 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140251 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140335 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140578 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140667 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140881 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.140974 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141176 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141263 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141473 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141562 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141772 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.141856 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142073 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142163 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142371 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142456 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142681 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142765 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.142978 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143064 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143278 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143365 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143601 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143685 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.143911 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.144014 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.144234 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.144593 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.144748 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.144926 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.145057 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.145271 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.145358 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.145592 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.145689 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.145924 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.146015 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.146221 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.146320 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.146520 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.146607 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.146819 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.146913 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.147131 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.147226 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.147447 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.147539 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.147749 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.147848 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.148049 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.148135 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.148348 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.148491 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.148687 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:37:46.148794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149006 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149098 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149331 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149424 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149645 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149739 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.149962 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150047 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150281 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150374 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150594 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150681 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.150997 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.151224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.151416 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.151576 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.151725 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.151870 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152010 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152144 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152287 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152450 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152551 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152741 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.152834 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153138 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153221 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153467 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153560 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153782 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.153884 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154096 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154190 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154406 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154522 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154719 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.154820 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155025 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155127 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155338 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155432 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155656 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155750 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.155970 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156063 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156275 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156437 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156614 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156701 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.156930 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157033 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157294 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157389 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157561 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157658 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.157881 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.158352 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.158551 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.158638 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.158859 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.158952 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.159170 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.159305 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.159491 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.159641 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.159848 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.160167 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.160430 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.160534 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.160717 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.160804 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161036 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161120 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161348 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161443 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161660 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161752 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.161971 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162065 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162281 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162367 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162591 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162684 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.162920 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163005 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163226 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163310 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163536 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163618 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163849 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.163993 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164210 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164296 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164477 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164564 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164785 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.164869 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165093 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165187 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165397 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165487 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165697 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165793 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.165999 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166093 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166305 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166391 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166607 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166702 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.166923 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167014 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167233 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167318 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167532 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167851 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.167935 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168155 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168239 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168494 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168597 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168796 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.168889 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169100 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169193 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169403 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169491 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169719 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.169817 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170020 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170106 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170322 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170415 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170642 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170728 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.170950 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171036 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171253 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171348 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171574 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171667 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171880 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.171965 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172182 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172275 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172509 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172606 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172819 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.172912 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173124 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173208 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173430 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173522 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173734 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.173826 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174040 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174132 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174345 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174430 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174649 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174741 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.174954 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.175046 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.175304 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.175614 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.175729 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.175920 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176045 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176225 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176372 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176557 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176719 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.176901 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177034 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177212 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177337 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177556 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177654 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177894 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.177979 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178210 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178340 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178507 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178602 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178811 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.178897 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179110 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179195 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179409 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179505 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179708 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.179794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180006 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180092 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180306 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180428 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180658 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180745 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.180962 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181056 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181260 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181358 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181558 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181654 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181856 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.181943 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182182 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182273 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182484 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182576 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182796 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.182887 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183116 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183203 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183432 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183523 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183750 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.183848 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184056 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184151 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184369 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184697 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.184794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185005 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185091 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185310 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185395 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185616 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185710 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.185926 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186011 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186229 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186541 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186645 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186846 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.186933 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187162 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187246 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187465 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187558 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187778 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.187863 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188079 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188166 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188406 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188496 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188711 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.188795 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189026 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189113 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189358 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189452 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189671 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189764 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.189976 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190070 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190285 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190372 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190588 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190674 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.190989 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.191091 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.191299 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.191615 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.191701 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.191926 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192018 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192236 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192332 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192575 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192665 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.192896 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193001 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193214 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193304 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193527 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193613 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193840 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.193932 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194152 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194238 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194455 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194548 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194761 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.194846 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195069 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195156 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195382 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195468 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195688 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195780 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.195995 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196080 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196314 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196436 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196647 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196746 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.196954 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197046 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197257 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197352 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197560 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197655 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197862 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.197953 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198168 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198288 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198472 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198566 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198774 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.198859 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199079 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199164 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199380 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199470 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199689 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199783 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.199993 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200086 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200291 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200427 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200616 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200703 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.200921 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201009 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201237 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201323 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201539 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201623 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201858 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.201943 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202172 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202257 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202477 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202569 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202778 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.202871 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203087 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203173 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203388 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203484 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203688 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203786 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.203987 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204080 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204289 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204374 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204652 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204754 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.204958 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205043 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205255 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205348 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205565 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205661 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205880 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.205964 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.206187 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.206524 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.206732 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.206905 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207230 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207325 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207552 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207646 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207874 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.207963 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208199 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208292 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208534 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208632 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208846 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.208933 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209156 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209255 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209465 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209565 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209775 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.209870 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210094 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210187 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210398 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210491 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210705 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.210805 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211008 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211092 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211308 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211616 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211708 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.211926 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212011 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212230 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212529 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212635 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212855 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.212946 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213169 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213255 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213485 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213577 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213791 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.213875 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214104 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214189 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214412 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214510 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214737 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.214827 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215046 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215132 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215352 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215449 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215659 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215746 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.215960 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216044 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216266 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216359 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216600 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216696 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.216904 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217023 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217206 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217378 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217501 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217685 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217801 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.217995 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218103 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218305 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218392 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218631 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218718 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.218938 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219024 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219248 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219342 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219554 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219639 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219860 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.219945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220162 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220249 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220499 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220588 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220801 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.220900 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221103 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221189 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221404 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221490 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221717 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.221818 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.222128 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.222237 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.222365 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.222671 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.222959 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223055 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223296 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223380 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223606 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223693 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.223913 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224007 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224229 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224315 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224561 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224661 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224872 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.224961 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225178 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225263 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225481 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225574 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225784 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.225871 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226090 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226177 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226394 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226477 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226692 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226778 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.226999 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227084 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227302 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227387 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227606 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227703 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.227909 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228003 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228209 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228304 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228538 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228843 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.228928 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229152 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229253 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229456 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229541 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229756 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.229842 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230057 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230153 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230363 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230471 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230665 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230751 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.230965 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231061 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231288 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231379 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231566 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231652 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231870 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.231964 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232170 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232262 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232503 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232596 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232803 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.232897 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233107 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233194 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233411 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233502 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233707 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.233792 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234013 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234105 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234316 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234410 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234618 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234705 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.234919 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235012 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235221 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235316 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235518 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235602 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235816 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.235910 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236119 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236213 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236459 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236550 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236774 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.236860 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237074 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237219 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237379 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237474 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237703 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.237789 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.238063 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.238382 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.238473 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.238691 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.238780 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239010 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239094 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239311 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239613 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239700 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.239914 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240009 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240217 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240345 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240542 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240628 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240861 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.240996 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241166 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241267 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241465 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241553 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241767 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.241861 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242064 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242163 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242399 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242484 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242695 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.242788 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243012 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243098 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243324 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243411 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243631 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243717 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.243937 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244021 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244239 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244324 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244571 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244697 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244881 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.244967 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245179 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245265 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245552 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245648 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245793 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.245879 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246099 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246192 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246397 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246695 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.246783 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247009 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247108 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247312 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247405 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247617 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247701 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.247927 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248030 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248230 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248317 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248571 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248661 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248870 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.248968 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249172 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249306 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249480 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249619 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249779 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.249930 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250084 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250235 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250385 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250544 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250690 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250857 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.250995 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251180 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251313 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251486 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251582 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251791 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.251876 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252174 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252258 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252502 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252605 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252808 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.252896 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.253109 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.253202 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.253595 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.253698 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.253905 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.254221 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.254387 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.254548 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.254704 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.254857 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255016 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255166 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255323 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255474 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255633 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255798 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.255937 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.256103 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.256372 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.256512 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.256707 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.256853 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257016 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257167 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257321 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257478 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257630 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257894 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.257980 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258208 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258301 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258520 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258823 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.258915 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259156 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259241 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259481 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259578 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259787 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.259873 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260104 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260189 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260427 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260561 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260729 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.260818 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261039 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261125 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261359 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261445 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261660 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261745 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.261960 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262059 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262260 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262347 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262580 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262674 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262880 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.262976 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.263197 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.263303 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.263607 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.263757 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.263915 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264002 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264215 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264568 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264656 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264899 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.264984 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265208 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265307 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265517 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265603 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265829 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.265914 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266135 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266233 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266432 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266517 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266740 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.266827 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267044 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267137 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267355 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267440 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267666 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267760 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.267967 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268053 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268272 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268358 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268594 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268745 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.268939 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.269030 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.269246 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.269556 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.269802 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.269889 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270125 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270213 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270450 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270537 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270782 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.270885 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271107 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271201 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271416 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271503 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271723 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.271822 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272030 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272117 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272333 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272446 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272685 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272783 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.272994 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273081 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273298 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273384 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273599 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273695 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.273917 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274004 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274221 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274307 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274529 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274616 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274836 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.274922 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275138 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275233 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275438 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275526 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275737 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.275822 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276054 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276147 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276356 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276484 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276698 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.276784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277004 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277089 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277314 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277400 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277622 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277708 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.277922 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278022 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278228 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278314 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278531 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278644 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278833 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.278939 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279129 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279224 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279427 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279525 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279751 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.279844 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280049 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280134 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280353 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280508 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280684 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280794 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.280991 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281093 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281335 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281430 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281642 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281729 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.281980 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.282066 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.282305 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.282398 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.282614 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.282708 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283297 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283389 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283601 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283687 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283901 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.283988 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.284208 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.284302 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.284596 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.284688 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.284959 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.285281 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.285365 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.285602 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.285690 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.285921 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286008 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286241 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286337 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286541 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286844 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.286933 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.287164 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.287258 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.287466 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.287552 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.287786 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288036 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288123 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288371 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288493 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288699 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.288795 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289004 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289101 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289314 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289399 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289634 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289720 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.289940 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290024 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290254 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290339 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290569 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290662 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290883 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.290984 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291187 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291272 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291510 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291598 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291824 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.291910 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292137 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292233 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292483 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292584 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292799 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.292887 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293115 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293209 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293430 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293523 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293744 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.293828 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294047 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294208 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294360 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294454 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294671 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294757 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.294982 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295069 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295304 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295531 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295617 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295853 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.295948 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296163 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296251 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296499 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296591 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296810 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.296907 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297123 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297217 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297432 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297518 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297741 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.297828 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298048 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298134 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298355 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298440 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298662 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.298749 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299002 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299135 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299299 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299385 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299624 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299711 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.299941 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.300033 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.300280 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.300621 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301046 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301132 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301388 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301476 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301718 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.301883 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302047 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302123 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302372 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302477 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302683 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302778 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.302999 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303086 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303310 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303396 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303616 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303711 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.303925 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304018 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304235 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304319 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304566 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304659 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304876 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.304975 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305184 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305271 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305489 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305575 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305797 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.305883 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.306107 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.306204 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.306426 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.306642 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.306758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307000 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307094 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307406 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307647 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307733 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.307965 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308049 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308283 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308556 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308654 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308819 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.308929 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309157 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309266 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309557 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309789 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.309875 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310104 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310192 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310416 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310512 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310719 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.310805 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311026 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311111 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311328 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311415 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311632 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311724 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.311934 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312019 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312232 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312581 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312671 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312888 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.312984 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313188 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313275 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313495 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313588 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313796 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.313882 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314101 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314316 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314409 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314662 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314749 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.314977 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315062 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315296 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315382 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315599 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315685 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.315980 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.316166 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.316537 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.316716 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.316821 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317024 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317114 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317338 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317431 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317699 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.317787 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318022 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318115 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318328 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318413 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318635 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318736 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.318940 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319035 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319249 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319343 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319554 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319642 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319857 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.319952 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320165 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320251 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320491 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320582 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320819 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.320919 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.321126 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.321359 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.321448 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.321702 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.321787 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322010 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322109 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322313 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322401 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322622 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322708 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.322924 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323010 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323226 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323313 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323534 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323628 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323834 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.323926 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324138 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324236 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324470 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324559 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324779 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.324878 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325080 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325167 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325387 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325474 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325699 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.325792 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326012 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326101 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326324 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326410 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326623 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326717 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.326931 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327016 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327234 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327544 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327637 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327849 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.327934 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328156 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328243 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328527 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328675 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328836 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.328929 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.329154 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.329362 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.329466 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.329693 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.329782 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330010 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330096 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330338 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330438 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330666 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.330968 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.331053 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.331271 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.331431 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.331659 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.331952 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.332064 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.332341 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.332455 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.332741 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.332828 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333056 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333144 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333368 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333463 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333680 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333768 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.333988 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334075 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334297 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334385 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334606 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334692 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334912 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.334998 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335217 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335305 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335521 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335609 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335823 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.335911 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336131 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336229 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336453 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336545 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336764 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.336868 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337197 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337412 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337503 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337724 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.337820 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338035 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338122 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338348 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338469 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338654 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338766 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.338959 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339060 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339260 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339381 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339564 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339663 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339866 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.339952 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340173 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340267 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340507 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340606 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340809 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.340896 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341117 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341227 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341425 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341528 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341735 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.341822 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342041 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342128 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342348 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342442 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342654 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342741 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.342963 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343064 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343277 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343364 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343583 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343670 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343888 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.343982 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344193 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344287 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344525 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344616 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344828 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.344928 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345163 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345257 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345464 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345557 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345764 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.345852 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346065 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346150 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346368 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346462 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346680 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346768 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.346986 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.347199 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.347494 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.347829 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.347932 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348142 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348229 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348477 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348578 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348783 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.348879 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349085 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349179 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349389 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349531 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349692 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349780 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.349995 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350083 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350294 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350389 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350595 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350684 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350894 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.350981 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351195 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351290 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351494 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351589 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351792 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.351881 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352095 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352182 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352424 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352516 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352726 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.352813 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353091 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353212 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353426 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353513 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353742 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.353829 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354057 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354152 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354373 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354460 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354687 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.354773 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355000 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355103 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355406 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355637 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355723 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.355965 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356053 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356296 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356396 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356634 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356721 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.356943 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357030 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357249 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357335 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357672 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357885 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.357974 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358191 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358285 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358502 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358588 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358808 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.358934 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.359113 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.359201 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.359420 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.359515 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.359691 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:37:46.359795 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.360048 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.360349 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.360696 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.361013 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.361328 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.361640 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.361947 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.362275 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.362582 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.363413 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.363734 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.364046 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.364356 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.364693 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.365009 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.365336 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.365661 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.365969 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.366293 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.366616 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.366960 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.367267 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.367605 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.367930 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.368239 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.368579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.368883 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:37:46.369124 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:37:46.422472 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO dbcounter [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Registered counter for database nova_api Jun 28 17:37:46.432826 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Registered counter for database nova_api Jun 28 17:37:46.538752 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.545319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writer thread running {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.553465 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.560589 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.602754 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.context [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565058e1-194e-4f59-84a2-1c095abe2191(cell1) {{(pid=109842) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 17:37:46.606825 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:37:46.608413 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:37:46.609254 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:37:46.611369 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:37:46.613711 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO dbcounter [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Registered counter for database nova_cell0 Jun 28 17:37:46.616672 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.context [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565058e1-194e-4f59-84a2-1c095abe2191(cell1) {{(pid=109843) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 17:37:46.617666 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO dbcounter [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Registered counter for database nova_cell1 Jun 28 17:37:46.620759 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:37:46.625149 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:37:46.625149 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:37:46.625371 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_concurrency.lockutils [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:37:46.626117 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.627324 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.627448 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Registered counter for database nova_cell0 Jun 28 17:37:46.631674 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Registered counter for database nova_cell1 Jun 28 17:37:46.634276 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writer thread running {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.635579 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writer thread running {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.639372 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.644562 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.645214 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.782271 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO dbcounter [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Registered counter for database nova_cell0 Jun 28 17:37:46.787804 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.791982 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.796753 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writer thread running {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:46.797211 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO dbcounter [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Registered counter for database nova_cell0 Jun 28 17:37:46.809347 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG oslo_db.sqlalchemy.engines [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:37:46.814721 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writer thread running {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:37:47.133587 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:37:47.134852 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: WARNING keystonemiddleware.auth_token [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:37:47.140890 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:37:47.142186 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: WARNING keystonemiddleware.auth_token [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:37:47.483884 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: WARNING keystonemiddleware.auth_token [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:37:47.489978 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: WARNING keystonemiddleware.auth_token [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:37:47.494326 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:37:47.495254 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55da882309c0 pid: 109842 (default app) Jun 28 17:37:47.497343 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:37:47.498529 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001769 Jun 28 17:37:47.498955 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Jun 28 17:37:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:37:47.500293 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: WARNING keystonemiddleware.auth_token [None req-b7672b7d-32b0-419d-919f-62401a473d51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:37:47.505736 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55da882309c0 pid: 109843 (default app) Jun 28 17:39:07.581346 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:07.583317 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002795 Jun 28 17:39:07.584155 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:07.615241 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:07.617756 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell0:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:07.620217 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell1:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:07.621896 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_cell0:SELECT=3 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:08.313686 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-df474b6c-ef04-482a-9d23-8b078afc4852 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:08.349127 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-df474b6c-ef04-482a-9d23-8b078afc4852 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.753041 Jun 28 17:39:08.350204 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 28 17:39:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:10.610656 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:10.613110 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-3b875a17-a1a1-48eb-8b8e-b82c41e9d55b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Jun 28 17:39:10.613838 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:10.711981 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6e7c44e5-afe2-45b2-9c56-db83bbfa8a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:10.732132 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:39:10.732132 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 28 17:39:10.773046 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6e7c44e5-afe2-45b2-9c56-db83bbfa8a41 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.149381 Jun 28 17:39:10.774109 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:10.792597 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_api:SELECT=3 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:10.794166 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_cell0:SELECT=3 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:10.795418 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_cell1:SELECT=3 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:10.796902 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:11.189662 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-7bd00a8e-af94-4827-bd48-fd49768336c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:11.194479 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:39:11.194479 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:39:11.292561 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-7bd00a8e-af94-4827-bd48-fd49768336c0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.508706 Jun 28 17:39:11.293666 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 28 17:39:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:13.679169 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6e7c44e5-afe2-45b2-9c56-db83bbfa8a41 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:13.680778 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6e7c44e5-afe2-45b2-9c56-db83bbfa8a41 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Jun 28 17:39:13.681201 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:13.804953 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-44febb15-1c1c-43b6-b9e5-8023608768b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:13.823515 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:39:13.823515 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:39:13.842359 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-44febb15-1c1c-43b6-b9e5-8023608768b0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154513 Jun 28 17:39:13.842991 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:13.855672 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-553bf8f9-3f9a-48c5-8d41-66dcf1fa24cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:13.857382 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:39:13.857382 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: warnings.warn(msg) Jun 28 17:39:13.891477 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-553bf8f9-3f9a-48c5-8d41-66dcf1fa24cc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039456 Jun 28 17:39:13.892316 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 28 17:39:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:16.007743 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-44febb15-1c1c-43b6-b9e5-8023608768b0 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:16.008871 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-44febb15-1c1c-43b6-b9e5-8023608768b0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jun 28 17:39:16.009257 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:39:16.099721 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6745bb9f-93ee-49a5-9379-f43f95e27c3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:16.122645 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6745bb9f-93ee-49a5-9379-f43f95e27c3a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.106869 Jun 28 17:39:16.123180 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:16.136217 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-aea9b451-a23c-41af-ab3d-0aa4e374cf92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:16.170931 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-aea9b451-a23c-41af-ab3d-0aa4e374cf92 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038491 Jun 28 17:39:16.172121 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 28 17:39:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:18.546206 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-6745bb9f-93ee-49a5-9379-f43f95e27c3a admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:18.547540 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-6745bb9f-93ee-49a5-9379-f43f95e27c3a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jun 28 17:39:18.548437 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:39:18.616799 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6cc7307f-c7af-4439-bb72-7f475fe9c996 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "ram": 2048, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:18.634878 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-6cc7307f-c7af-4439-bb72-7f475fe9c996 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079999 Jun 28 17:39:18.635584 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:18.647925 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-5ee2986f-ed11-47c3-bdd4-c0d0574575c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:18.673080 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-5ee2986f-ed11-47c3-bdd4-c0d0574575c2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029197 Jun 28 17:39:18.673672 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 28 17:39:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:20.855840 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6cc7307f-c7af-4439-bb72-7f475fe9c996 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:20.857007 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-6cc7307f-c7af-4439-bb72-7f475fe9c996 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 Jun 28 17:39:20.857726 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:20.925896 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:20.949585 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084213 Jun 28 17:39:20.950542 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:20.968565 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-68af19a9-eb9f-4547-97e3-eefc469220c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:20.995090 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-68af19a9-eb9f-4547-97e3-eefc469220c6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030411 Jun 28 17:39:20.995845 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 28 17:39:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:23.259407 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:23.260522 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 28 17:39:23.260925 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:23.335987 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-30afc435-3c53-4ec5-b877-507ccb769a4e admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:23.373979 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-30afc435-3c53-4ec5-b877-507ccb769a4e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.106799 Jun 28 17:39:23.374875 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 28 17:39:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:39:25.832473 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:25.833548 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-9e798b6d-318e-47a8-93d3-40303dd7387d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Jun 28 17:39:25.833988 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:25.953014 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-75531dc2-53bd-4d96-8149-fddfe00558df admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "swap": 0}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:25.979364 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-75531dc2-53bd-4d96-8149-fddfe00558df admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.137843 Jun 28 17:39:25.980185 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:25.995841 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-1309b7cb-5f1a-4e5d-8bf8-ad076d01bd66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:26.024216 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-1309b7cb-5f1a-4e5d-8bf8-ad076d01bd66 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032509 Jun 28 17:39:26.024937 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 28 17:39:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:28.343288 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-75531dc2-53bd-4d96-8149-fddfe00558df admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:28.344660 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-75531dc2-53bd-4d96-8149-fddfe00558df admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Jun 28 17:39:28.345299 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:28.438172 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e63e7071-71d0-4f3a-be4c-58a921dea8a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "swap": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:28.465524 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-e63e7071-71d0-4f3a-be4c-58a921dea8a4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.110448 Jun 28 17:39:28.466124 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:28.479367 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-30aa3d7a-7bd4-44ca-8375-43abd2abaddf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:28.506347 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-30aa3d7a-7bd4-44ca-8375-43abd2abaddf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030806 Jun 28 17:39:28.507027 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 28 17:39:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:30.674167 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-e63e7071-71d0-4f3a-be4c-58a921dea8a4 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:30.675575 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-e63e7071-71d0-4f3a-be4c-58a921dea8a4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jun 28 17:39:30.675971 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:30.744647 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-bb998b8f-d60c-40be-984a-35246c38255a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:30.774371 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-bb998b8f-d60c-40be-984a-35246c38255a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.091640 Jun 28 17:39:30.775513 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:30.791932 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-456dc50a-a5ce-4670-b48f-9e0f3d8614fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:30.824577 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-456dc50a-a5ce-4670-b48f-9e0f3d8614fe admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038689 Jun 28 17:39:30.825219 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 28 17:39:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:32.957114 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-bb998b8f-d60c-40be-984a-35246c38255a admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:32.958825 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-bb998b8f-d60c-40be-984a-35246c38255a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jun 28 17:39:32.959433 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:33.028480 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a752e5b7-ea93-49a0-aa66-d9e135aa71e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "disk": 80}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:33.050285 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-a752e5b7-ea93-49a0-aa66-d9e135aa71e0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083061 Jun 28 17:39:33.050859 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:39:33.064986 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-22406fc3-a2b9-4d70-852a-e97e99f18b94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:33.090462 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-22406fc3-a2b9-4d70-852a-e97e99f18b94 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029812 Jun 28 17:39:33.091352 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 28 17:39:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:39:35.252304 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a752e5b7-ea93-49a0-aa66-d9e135aa71e0 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:39:35.253760 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-a752e5b7-ea93-49a0-aa66-d9e135aa71e0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Jun 28 17:39:35.254315 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:39:35.337683 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "swap": 0, "disk": 160}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:35.369736 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.106120 Jun 28 17:39:35.370551 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 28 17:39:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 17:39:35.389378 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-3c5574ad-3fbc-4532-a409-05ef99161c0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:39:35.428709 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-3c5574ad-3fbc-4532-a409-05ef99161c0d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046206 Jun 28 17:39:35.430355 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 28 17:39:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:40:00.224146 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:00.225177 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 28 17:40:00.225581 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:00.236649 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:00.290170 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-86db96a8-d1a9-4080-8400-b620fadd5b41 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:00.307655 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-86db96a8-d1a9-4080-8400-b620fadd5b41 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075827 Jun 28 17:40:00.308200 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 28 17:40:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:01.233153 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:01.234154 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-537c19f2-2567-4b23-9346-aee2d30bfd8d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 28 17:40:01.234553 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:01.428207 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a1a38788-670f-4a35-b8cb-0da0733eaacf admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:01.434430 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-a1a38788-670f-4a35-b8cb-0da0733eaacf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a1a38788-670f-4a35-b8cb-0da0733eaacf admin admin] Request method failure captured: Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Host: 10.222.0.43 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABiuzzxMvC0TMIxgKs2VOEEgTOWYMUS4MjuNedVUcUnOSE2683b1Tk6q5FrgW0lvfkbVvw9MwlvkM36wgl9B3A5frQyi_WFZ9pjyT5LEf0WwKzX1O-J28355FoQHx-ftzMPat0Bq9DGbvW69kqm1S2NzNHK7YR7PAlO5SOgVJ2g1HK5SbU Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Role: member,reader,admin Jun 28 17:40:01.437758 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Roles: member,reader,admin Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User: admin Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: method: > Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: exception: Flavor 42 could not be found. Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: action_args: {'id': '42'} Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:01.439224 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:01.440290 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.441462 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-a1a38788-670f-4a35-b8cb-0da0733eaacf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:01.442554 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-a1a38788-670f-4a35-b8cb-0da0733eaacf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067600 Jun 28 17:40:01.442554 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 28 17:40:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:01.449398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-9a19de6f-f95c-4bdc-aa48-a0fdcfb94e88 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:01.452593 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:01.473388 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-9a19de6f-f95c-4bdc-aa48-a0fdcfb94e88 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027547 Jun 28 17:40:01.473964 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:01.484091 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-2c9fe66a-8be5-476b-9dbf-ec590b84a36f admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:01.506080 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-2c9fe66a-8be5-476b-9dbf-ec590b84a36f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025579 Jun 28 17:40:01.506662 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:01.517446 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6652959f-90ca-410e-985b-47c67175acc3 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:01.524272 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.wsgi [None req-6652959f-90ca-410e-985b-47c67175acc3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6652959f-90ca-410e-985b-47c67175acc3 admin admin] Request method failure captured: Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept: application/json Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept-Encoding: gzip, deflate Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Connection: keep-alive Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Content-Length: 0 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Host: 10.222.0.43 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-System-Scope: None Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: User-Agent: python-novaclient Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Auth-Token: gAAAAABiuzzxMvC0TMIxgKs2VOEEgTOWYMUS4MjuNedVUcUnOSE2683b1Tk6q5FrgW0lvfkbVvw9MwlvkM36wgl9B3A5frQyi_WFZ9pjyT5LEf0WwKzX1O-J28355FoQHx-ftzMPat0Bq9DGbvW69kqm1S2NzNHK7YR7PAlO5SOgVJ2g1HK5SbU Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Id: None Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Name: None Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Identity-Status: Confirmed Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Is-Admin-Project: True Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Id: default Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Name: Default Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Name: admin Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Role: member,reader,admin Jun 28 17:40:01.527627 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Roles: member,reader,admin Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant: admin Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Name: admin Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User: admin Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Id: default Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Name: Default Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Name: admin Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: method: > Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: exception: Flavor 42 could not be found. Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: action_args: {'id': '42'} Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:01.529122 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:01.530126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:01.531493 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6652959f-90ca-410e-985b-47c67175acc3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:01.533125 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-6652959f-90ca-410e-985b-47c67175acc3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016170 Jun 28 17:40:01.533125 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 28 17:40:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:02.374740 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-2c9fe66a-8be5-476b-9dbf-ec590b84a36f admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:02.375748 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-2c9fe66a-8be5-476b-9dbf-ec590b84a36f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 28 17:40:02.376185 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:02.576063 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-307a200f-5d65-4904-b7d0-13f37c76eceb admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:02.582344 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.wsgi [None req-307a200f-5d65-4904-b7d0-13f37c76eceb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-307a200f-5d65-4904-b7d0-13f37c76eceb admin admin] Request method failure captured: Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept: application/json Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept-Encoding: gzip, deflate Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Connection: keep-alive Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Content-Length: 0 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Host: 10.222.0.43 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-System-Scope: None Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: User-Agent: python-novaclient Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Auth-Token: gAAAAABiuzzyFvMcPFBuEcnv8tECNrd6902nlYB9d9adbCH49DBvXa8ljomnZW5DiZzMw-Qj_DHlLrOCXLGNqHfUUzZu2f9-sl2W2UxJQ6_3WK_0grm8jBta4cEQJtnpCvBIWrPSjECpwWGzlxt8ZsohoWy24ogAfC3oOqoZFUY6jnmhXDJCr4I Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Id: None Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Name: None Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Identity-Status: Confirmed Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Is-Admin-Project: True Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Id: default Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Name: Default Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Name: admin Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Role: member,reader,admin Jun 28 17:40:02.583794 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Roles: member,reader,admin Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant: admin Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Name: admin Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User: admin Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Id: default Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Name: Default Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Name: admin Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: method: > Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: exception: Flavor 84 could not be found. Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: action_args: {'id': '84'} Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:02.585398 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:02.586315 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.587392 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-307a200f-5d65-4904-b7d0-13f37c76eceb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:02.588422 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-307a200f-5d65-4904-b7d0-13f37c76eceb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069563 Jun 28 17:40:02.588422 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 28 17:40:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:02.595965 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aba7dd02-ea2b-4b0f-bdd5-45af73c3a6ef admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:02.611199 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aba7dd02-ea2b-4b0f-bdd5-45af73c3a6ef admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019382 Jun 28 17:40:02.611806 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:02.622059 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-ce9e7bec-799a-4c78-b131-2dc4a3d86d32 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:02.637228 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-ce9e7bec-799a-4c78-b131-2dc4a3d86d32 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018699 Jun 28 17:40:02.637795 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:02.650124 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-1940ac2e-24b6-4743-bcfe-41bd45374a69 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:02.658012 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-1940ac2e-24b6-4743-bcfe-41bd45374a69 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-1940ac2e-24b6-4743-bcfe-41bd45374a69 admin admin] Request method failure captured: Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Host: 10.222.0.43 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABiuzzyFvMcPFBuEcnv8tECNrd6902nlYB9d9adbCH49DBvXa8ljomnZW5DiZzMw-Qj_DHlLrOCXLGNqHfUUzZu2f9-sl2W2UxJQ6_3WK_0grm8jBta4cEQJtnpCvBIWrPSjECpwWGzlxt8ZsohoWy24ogAfC3oOqoZFUY6jnmhXDJCr4I Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Role: member,reader,admin Jun 28 17:40:02.660099 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Roles: member,reader,admin Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User: admin Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: method: > Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: exception: Flavor 84 could not be found. Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: action_args: {'id': '84'} Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:02.661615 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:02.662414 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:02.663512 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-1940ac2e-24b6-4743-bcfe-41bd45374a69 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:02.664594 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-1940ac2e-24b6-4743-bcfe-41bd45374a69 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016918 Jun 28 17:40:02.664594 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 28 17:40:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:03.498213 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-ce9e7bec-799a-4c78-b131-2dc4a3d86d32 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:03.499558 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-ce9e7bec-799a-4c78-b131-2dc4a3d86d32 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Jun 28 17:40:03.499973 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:03.693186 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-c51fa132-16e0-4a05-b8fd-6a5729c96145 admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:03.699415 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.wsgi [None req-c51fa132-16e0-4a05-b8fd-6a5729c96145 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-c51fa132-16e0-4a05-b8fd-6a5729c96145 admin admin] Request method failure captured: Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept: application/json Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Accept-Encoding: gzip, deflate Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Connection: keep-alive Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Content-Length: 0 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Host: 10.222.0.43 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Openstack-System-Scope: None Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: User-Agent: python-novaclient Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Auth-Token: gAAAAABiuzzzVmWvkYlbKgvs-UmoxnPZ2OM_9gRv8xL_6DgAvGO5EANPW2QoTtYsPpnUV80D5NKVd072LOxVh7kaIngK0G-UX6Z0G9zQ5-dMePyuYai8rTuxo1SVOmGhwx-tfiTjtJcP5zvbiyallc6giN7oFeKO5r8hDypuiCfVcmj8odzrp6g Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Id: None Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Domain-Name: None Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Identity-Status: Confirmed Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Is-Admin-Project: True Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Id: default Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Domain-Name: Default Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Project-Name: admin Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Role: member,reader,admin Jun 28 17:40:03.700907 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Roles: member,reader,admin Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant: admin Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-Tenant-Name: admin Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User: admin Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Id: default Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Domain-Name: Default Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: X-User-Name: admin Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: method: > Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: exception: Flavor 451 could not be found. Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: action_args: {'id': '451'} Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:03.702469 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:03.703579 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.704913 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-c51fa132-16e0-4a05-b8fd-6a5729c96145 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:03.706120 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-c51fa132-16e0-4a05-b8fd-6a5729c96145 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063745 Jun 28 17:40:03.706120 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:40:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:03.714008 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-8ff81616-b742-4260-a360-120316c12d74 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:03.732938 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-8ff81616-b742-4260-a360-120316c12d74 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022271 Jun 28 17:40:03.733759 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:03.744112 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:03.759682 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019036 Jun 28 17:40:03.760254 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 28 17:40:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:03.770523 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-a43c46a0-5950-4ed4-ac2c-6020a9754c3f admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:03.776413 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.wsgi [None req-a43c46a0-5950-4ed4-ac2c-6020a9754c3f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-a43c46a0-5950-4ed4-ac2c-6020a9754c3f admin admin] Request method failure captured: Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept: application/json Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Accept-Encoding: gzip, deflate Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Connection: keep-alive Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Content-Length: 0 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Host: 10.222.0.43 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-Api-Version: compute 2.90 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Openstack-System-Scope: None Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: User-Agent: python-novaclient Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Auth-Token: gAAAAABiuzzzVmWvkYlbKgvs-UmoxnPZ2OM_9gRv8xL_6DgAvGO5EANPW2QoTtYsPpnUV80D5NKVd072LOxVh7kaIngK0G-UX6Z0G9zQ5-dMePyuYai8rTuxo1SVOmGhwx-tfiTjtJcP5zvbiyallc6giN7oFeKO5r8hDypuiCfVcmj8odzrp6g Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Id: None Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Domain-Name: None Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Identity-Status: Confirmed Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Is-Admin-Project: True Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Id: default Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Domain-Name: Default Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Project-Name: admin Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Role: member,reader,admin Jun 28 17:40:03.777945 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Roles: member,reader,admin Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/88462ec450d04aa490d00ae6f908d9e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/88462ec450d04aa490d00ae6f908d9e8"}]}] Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant: admin Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Id: 88462ec450d04aa490d00ae6f908d9e8 Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-Tenant-Name: admin Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User: admin Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Id: default Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Domain-Name: Default Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Id: 2081c57cf087446196283723872eb96a Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: X-User-Name: admin Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: method: > Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: exception: Flavor 451 could not be found. Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: action_args: {'id': '451'} Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:40:03.780784 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:03.782126 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: ERROR nova.api.openstack.wsgi Jun 28 17:40:03.784321 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-a43c46a0-5950-4ed4-ac2c-6020a9754c3f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:40:03.785649 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-a43c46a0-5950-4ed4-ac2c-6020a9754c3f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012813 Jun 28 17:40:03.785649 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:40:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:04.604786 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:04.605812 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 28 17:40:04.606209 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:04.803099 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-39651ba9-a6a3-41db-9013-d9f5df429346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:40:04.823676 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-39651ba9-a6a3-41db-9013-d9f5df429346 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075777 Jun 28 17:40:04.824328 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 28 17:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:40:05.671996 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:05.673747 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002464 Jun 28 17:40:05.674438 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:05.870068 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-d9e0d245-1146-4bb8-8daa-a29dda9b0b99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:40:05.889394 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-d9e0d245-1146-4bb8-8daa-a29dda9b0b99 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076085 Jun 28 17:40:05.889954 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 28 17:40:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:40:06.732897 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:06.734086 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jun 28 17:40:06.734473 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:06.927448 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-70199f08-1419-4551-a985-bab4da948c1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:40:06.947572 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-70199f08-1419-4551-a985-bab4da948c1f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075515 Jun 28 17:40:06.948154 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 28 17:40:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:40:07.793949 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:07.795003 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Jun 28 17:40:07.795391 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:07.993010 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-f04c94ec-6c17-4822-906c-b977da1adfd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:40:08.015549 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-f04c94ec-6c17-4822-906c-b977da1adfd1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080804 Jun 28 17:40:08.016108 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 28 17:40:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:40:08.875083 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:08.876096 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 28 17:40:08.876511 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:09.069281 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-2ba747d9-5000-4fc8-9030-e3199eefb31e admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:09.088649 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-2ba747d9-5000-4fc8-9030-e3199eefb31e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073802 Jun 28 17:40:09.089187 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Jun 28 17:40:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:56.523796 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.524836 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-aadd8087-f08d-4d81-9692-5da9434d698c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 28 17:40:56.525241 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:40:56.536823 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:56.590743 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-f8e69651-0186-44ed-b43f-fe8f2c6e4416 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.610745 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-f8e69651-0186-44ed-b43f-fe8f2c6e4416 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078547 Jun 28 17:40:56.611358 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:40:56.634609 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-f77c567c-f8d8-45cc-be2f-4a5a75c1a7fb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.638080 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG dbcounter [-] [109843] Writing DB stats nova_api:SELECT=14 {{(pid=109843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:56.643737 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-f77c567c-f8d8-45cc-be2f-4a5a75c1a7fb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012835 Jun 28 17:40:56.644275 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:40:56.657120 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-03255df3-c612-4849-8c4e-f4be74e9125d admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.665296 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-03255df3-c612-4849-8c4e-f4be74e9125d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012676 Jun 28 17:40:56.665834 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:40:56.678652 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.686850 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012153 Jun 28 17:40:56.687362 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:40:56.699547 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-6a48dfc0-aee0-4a4e-8d57-381bd5de6f7b admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:40:56.709319 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-6a48dfc0-aee0-4a4e-8d57-381bd5de6f7b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013542 Jun 28 17:40:56.709875 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jun 28 17:40:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:44:19.186258 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:19.187581 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Jun 28 17:44:19.188130 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:44:19.331243 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_api:SELECT=6 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:19.453768 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:19.455556 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:44:19.455556 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:44:19.457422 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:19.457948 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:19.459092 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:19.459877 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:19.494911 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-5fd54254-61e5-48b0-af2e-7d3e6dc57abe admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165107 Jun 28 17:44:19.495486 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:44:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:44:20.348896 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:20.349901 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 28 17:44:20.350296 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:44:20.559958 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:20.561187 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:44:20.561187 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:44:20.562435 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:20.562804 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:20.563614 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:20.564038 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:20.583609 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-73873e84-dc42-4550-b2bf-441ac750e727 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.094088 Jun 28 17:44:20.584152 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:44:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:44:31.877959 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:31.879096 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 28 17:44:31.879483 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:44:32.039559 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_cell0:SELECT=4 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:32.040265 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_cell1:SELECT=4 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:32.041035 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG dbcounter [-] [109842] Writing DB stats nova_api:SELECT=8 {{(pid=109842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:32.098685 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:32.099855 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:44:32.099855 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:44:32.101074 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:32.101517 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:32.102330 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:32.102754 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:32.128275 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-c60a2ad0-79c7-4607-8033-250de462ce6f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093714 Jun 28 17:44:32.128863 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:44:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:44:33.026122 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: DEBUG nova.api.openstack.wsgi [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] Calling method '>' {{(pid=109843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:33.027282 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: INFO nova.api.openstack.requestlog [None req-d1b09c0c-bb6f-42e0-b00c-7019427b0cbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 28 17:44:33.028075 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: [pid: 109843|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 28 17:44:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:44:33.226166 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG nova.api.openstack.wsgi [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] Calling method '>' {{(pid=109842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:44:33.227365 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:44:33.227365 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: warnings.warn(msg) Jun 28 17:44:33.228564 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:33.228983 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:33.230070 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:44:33.230258 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: DEBUG oslo_concurrency.lockutils [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:44:33.251577 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: INFO nova.api.openstack.requestlog [None req-07cd32a9-a9a8-47e0-b983-81451767aeb9 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085062 Jun 28 17:44:33.252150 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: [pid: 109842|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 28 17:44:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:45:28.798891 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: Tue Jun 28 17:45:28 2022 - graceful shutdown triggered... Jun 28 17:45:28.799419 dv-cinder-848013-1-iscsi devstack@n-api.service[109843]: Gracefully killing worker 2 (pid: 109843)... Jun 28 17:45:28.798935 dv-cinder-848013-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 28 17:45:28.800399 dv-cinder-848013-1-iscsi devstack@n-api.service[109842]: Gracefully killing worker 1 (pid: 109842)... Jun 28 17:45:29.800009 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: worker 1 buried after 1 seconds Jun 28 17:45:29.800009 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: worker 2 buried after 1 seconds Jun 28 17:45:29.800009 dv-cinder-848013-1-iscsi devstack@n-api.service[109841]: goodbye to uWSGI. Jun 28 17:45:29.801689 dv-cinder-848013-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 28 17:45:29.802254 dv-cinder-848013-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 28 17:45:29.805135 dv-cinder-848013-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 17:45:29.815758 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 17:45:29.818115 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 17:45:29 2022] *** Jun 28 17:45:29.818357 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 17:45:29.818546 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 17:45:29.818714 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: nodename: dv-cinder-848013-1-iscsi Jun 28 17:45:29.818885 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: machine: x86_64 Jun 28 17:45:29.819056 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: clock source: unix Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: pcre jit disabled Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: detected number of CPU cores: 4 Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: current working directory: / Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: detected binary path: /usr/bin/uwsgi-core Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: your processes number limit is 47680 Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: your memory page size is 4096 bytes Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: detected max file descriptor number: 2048 Jun 28 17:45:29.819255 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: lock engine: pthread robust mutexes Jun 28 17:45:29.819820 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: thunder lock: enabled Jun 28 17:45:29.819820 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 17:45:29.819820 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 17:45:29.865430 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: Python main interpreter initialized at 0x55faec1d69c0 Jun 28 17:45:29.865430 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: python threads support enabled Jun 28 17:45:29.865430 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: your server socket listen backlog is limited to 100 connections Jun 28 17:45:29.865430 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: your mercy for graceful operations on workers is 90 seconds Jun 28 17:45:29.865916 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 17:45:29.865916 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: *** Operational MODE: preforking *** Jun 28 17:45:29.866188 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: *** uWSGI is running in multiple interpreter mode *** Jun 28 17:45:29.866188 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: spawned uWSGI master process (pid: 124314) Jun 28 17:45:29.866411 dv-cinder-848013-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 17:45:29.866955 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: spawned uWSGI worker 1 (pid: 124336, cores: 1) Jun 28 17:45:29.867499 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: spawned uWSGI worker 2 (pid: 124337, cores: 1) Jun 28 17:45:29.867794 dv-cinder-848013-1-iscsi devstack@n-api.service[124314]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 17:45:30.522317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 17:45:30.522989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 17:45:31.715145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:45:31.715145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: from cryptography.utils import int_from_bytes Jun 28 17:45:31.715834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:45:31.715834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: from cryptography.utils import int_from_bytes Jun 28 17:45:31.716258 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:45:31.716258 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: from cryptography.utils import int_from_bytes Jun 28 17:45:31.716402 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:45:31.716402 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: from cryptography.utils import int_from_bytes Jun 28 17:45:34.115564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:45:34.116178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:45:34.116639 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:45:34.116744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:45:34.116848 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:45:34.116936 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:45:34.117026 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:45:34.117112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:45:34.117206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:45:34.117381 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:45:34.117478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.117572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.117734 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.117824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.117918 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.118132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.118334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.118477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.118611 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.118850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119018 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.119938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120227 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120790 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.120920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-1-iscsi {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121046 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848013-1-iscsi {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121813 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.121926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122266 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122738 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122854 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.122980 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.123291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.123550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.123679 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.123763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.124730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.124839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.124923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125012 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125090 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125272 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125480 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125669 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.125837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126303 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126432 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126699 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126828 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-1-iscsi {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.126990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.127735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.127975 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848013-1-iscsi {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.128963 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.129143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.129279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.129568 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.129735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.129870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130013 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130273 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130402 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130666 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.130804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.131206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.131532 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.131880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.132171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.132541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.132848 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.133181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.133409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.133732 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.133941 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.134202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.134413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.134627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.134877 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.135090 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.135301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.135515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.135721 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.135955 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.136203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.136475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.136726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.136929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.137671 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.137887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.138093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.138308 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.138308 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.138736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.138736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.139232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.139449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.139689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.139901 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.140117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.140331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.140563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.140784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.141007 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.141222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.141424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.141624 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.141840 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.142052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.142279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.142497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.142697 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.142896 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.143109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.143478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.143682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.143885 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.144095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.144298 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.144543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.144767 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.144985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.145201 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.145402 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.145609 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.145811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.146031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.146242 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.146242 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.146638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.146638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.147055 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.147306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.148070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.148301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.148584 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.148814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.149044 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.149258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.149462 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.149665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.149877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.150082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.150300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.150514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.150726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.150942 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.151153 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.151733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.151942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152103 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.152987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153286 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.153911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154063 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154716 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.154886 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155039 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155644 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.155952 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.156096 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.156261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.156488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.156716 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.156924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.157135 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.157332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.158241 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.158483 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.158709 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.158925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.159141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.159353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.159553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.159792 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.159995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.160197 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.160414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.160630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.160839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.161049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.161257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.161453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.161682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.161889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.162095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.162303 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.162516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.162737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.162952 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.163175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.163403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.163614 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.163768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.163913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164063 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.164870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165013 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165330 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165668 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.165967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.166869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.167021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.167178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.167322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.167479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.167685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.168523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.168751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.168972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.169196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.169396 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.169600 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.169801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.169996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.170217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.170425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.170629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.170835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.171040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.171249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.171446 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.171653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.171883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.172094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.172094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.172531 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.172733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.172941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.173136 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:45:34.173343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.173544 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.173771 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.173988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.174197 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.174522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.174753 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.174918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175063 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.175962 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.176947 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177236 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177379 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177532 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177692 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.177846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.178025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.178639 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.178851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.179071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.179282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.179493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.179703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.179909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.180108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.180305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.180587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.180786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.180994 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.181191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.181391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.181595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.181821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.182028 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.182238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.182435 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.182646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.182846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.183058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.183267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.183466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.183662 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.183858 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.184055 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.184276 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.184497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.184697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.184911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.185138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.185461 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.185686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.185906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186137 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.186912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187066 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187211 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187509 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.187959 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.188114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.188810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.188981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189316 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.189932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190410 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190709 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.190862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191469 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191629 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191785 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.191959 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.192161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.192369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.192622 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.192835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.192835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.193220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.193418 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.193614 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.193821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.194043 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.194242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.194445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.194642 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.194850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.195069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.195275 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.195472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.195678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.195886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.196095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.196304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.196544 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.196743 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.196949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.197146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.197344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.197557 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.197775 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.197775 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.198151 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.198390 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.199253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.199482 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.199678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.199880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.200987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201140 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201292 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201445 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.201903 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202357 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.202948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203099 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203267 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203420 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.203872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204501 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.204947 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205233 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205386 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205531 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.205948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206247 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206399 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206544 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.206847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207597 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.207897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.208049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.208202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.208355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.208585 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.208748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.209359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.209536 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.209691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.209837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.209990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210302 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.210908 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211062 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211509 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.211964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212785 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.212929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.213972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214331 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214643 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.214940 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215251 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215556 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215709 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215854 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.215998 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.216973 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217127 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217273 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217703 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.217854 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218391 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.218833 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.219491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.219657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.219804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.219957 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220103 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.220911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221057 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221582 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221733 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.221886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222389 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.222985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223572 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.223883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.224964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.225870 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226454 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.226928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227230 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227546 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227836 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.227989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228634 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.228957 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.229108 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.229714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.229883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230681 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.230983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231298 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231462 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231764 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.231922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.232896 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233047 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233378 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233849 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.233999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234319 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234624 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.234932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235558 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.235869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236346 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236565 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.236945 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.237131 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.237284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.237529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.237689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.237850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238002 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238162 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238465 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238616 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.238917 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.239081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.239233 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.239759 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240831 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.240996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.241147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.241306 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.241689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.241858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242033 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242033 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242506 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242665 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.242984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.243285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.243447 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.243600 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.243757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.243918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244069 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244802 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.244955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245276 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.245927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246247 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.246900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247052 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247368 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.247983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.248950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.249225 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.249398 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.249901 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.250950 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251123 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251606 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251758 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.251926 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.252079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.252238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.252556 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.252811 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253016 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253657 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.253977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254776 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.254927 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255392 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.255866 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256845 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.256997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.257155 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.257387 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.257560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.257714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.257864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258494 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.258965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.259114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.259274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.259444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.259596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.260125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.260441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.260615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.260769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.260932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261254 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.261904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262223 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.262853 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.263927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264090 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.264910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265063 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265376 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265837 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.265994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266327 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.266938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.267238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.267390 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.267556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.267717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.267878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268800 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.268976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.269182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.269389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.269542 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.269701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.269873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.270444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.270700 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.270878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271033 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271184 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.271970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.272990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273315 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.273949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274101 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274262 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.274893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275378 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.275841 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.276006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.276166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.276703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.276860 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277330 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.277964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278123 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278284 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.278891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279533 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.279853 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.280035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.280650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.280926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281084 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281395 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.281916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282716 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.282870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283029 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283647 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.283890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.284116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.284352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.284545 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.284713 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.284866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285831 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.285992 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286153 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.286946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287259 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.287884 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288043 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288195 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288357 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.288906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289760 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.289962 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.290125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.290312 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.290881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291330 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291482 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291641 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291821 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.291977 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292136 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292457 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.292938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293091 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293734 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.293894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294513 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294665 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.294965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295285 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295453 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.295916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296602 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.296919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297406 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297716 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.297868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298607 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.298908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299072 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299460 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299619 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.299948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.300101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.300260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.300448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301008 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301194 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301628 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301791 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.301966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302282 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.302915 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303399 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.303873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304046 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304725 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.304885 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305208 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.305832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306005 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306468 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306619 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.306952 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307266 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307423 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.307901 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.308907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.309850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.310011 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.310182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.310335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.310499 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.310659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.311231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.311401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.311672 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.311846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312014 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312168 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312321 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.312893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.313891 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314209 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.314857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.315978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316770 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.316940 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317402 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.317868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.318164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.318314 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.318474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.318628 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.318780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319191 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319354 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.319994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.320146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.320297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.320528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.320693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.320847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.321432 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.321592 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.321862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322034 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322341 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322492 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.322962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323284 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.323919 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324230 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.324881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325505 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.325996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326155 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.326781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327573 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.327898 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328060 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328579 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328740 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.328892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.329843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330307 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.330874 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.331033 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.331571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.331571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.331908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.332149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.332327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.332838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333014 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.333970 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334123 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.334932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335083 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335563 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.335886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336037 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336537 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336703 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.336856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337008 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337319 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337492 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.337966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338282 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.338905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.339871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340195 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.340864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.341028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.341188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.341737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.341907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342318 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342492 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342829 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.342981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343282 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343753 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.343904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344506 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344827 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.344999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.345941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346299 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.346931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347342 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.347969 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.348981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.349929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350388 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.350869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.351029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.351029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.351339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.351903 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352519 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352844 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.352997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353647 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353812 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.353964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354600 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354753 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.354904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355690 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.355849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356011 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356174 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356337 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.356860 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357033 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357499 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.357982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358133 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.358928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359090 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359402 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359554 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.359885 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360709 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.360863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.361024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.361177 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.361328 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.361479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.362079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.362261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.362427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.362693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.362862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363660 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363822 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.363987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364473 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.364976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.365895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366667 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366829 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.366982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367455 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367772 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.367932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368438 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368618 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.368970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369286 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.369904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370525 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370840 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.370995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.371154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.371319 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.371471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.371627 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.371802 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.372303 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.372491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.372958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373129 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373302 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.373951 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374104 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374265 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374265 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374556 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.374875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375495 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375725 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.375887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376046 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.376895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.377917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378378 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378542 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378702 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.378854 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379013 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379502 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379654 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.379964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380285 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.380788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381077 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381568 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.381883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.382606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.382783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.382783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.383196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.383354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.383515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.383684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.383838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.384892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.385979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.386267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.386429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.386581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.386734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.386884 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387363 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.387981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388494 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.388968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389755 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.389914 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.390086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.390239 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.390398 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.390565 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.390725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.391490 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.391656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.391812 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.391965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.392151 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.392737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.392909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.393107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.393412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.393588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.393751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.393912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394482 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394803 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.394953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395286 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.395937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.396894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397384 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397536 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.397850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398639 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.398800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.399905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.400071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.400231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.400418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.400577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.400760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.401056 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.401227 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.401765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.401918 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.402070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.402222 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.402855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403350 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.403967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404120 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.404909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405008 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405103 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405476 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.405933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406402 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406515 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406732 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.406947 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407037 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407037 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:45:34.407386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:45:34.434226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO dbcounter [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Registered counter for database nova_api Jun 28 17:45:34.440103 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO dbcounter [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Registered counter for database nova_api Jun 28 17:45:34.455101 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_db.sqlalchemy.engines [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.463809 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writer thread running {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.471559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_db.sqlalchemy.engines [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.483529 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writer thread running {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.525206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.context [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565058e1-194e-4f59-84a2-1c095abe2191(cell1) {{(pid=124336) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 17:45:34.529668 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:45:34.531296 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:45:34.532085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:45:34.534155 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:45:34.536233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO dbcounter [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Registered counter for database nova_cell0 Jun 28 17:45:34.540413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO dbcounter [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Registered counter for database nova_cell1 Jun 28 17:45:34.542715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.context [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565058e1-194e-4f59-84a2-1c095abe2191(cell1) {{(pid=124337) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 17:45:34.546862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:45:34.548418 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_db.sqlalchemy.engines [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.548576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:45:34.549397 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:45:34.549834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_db.sqlalchemy.engines [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.551673 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:45:34.553759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO dbcounter [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Registered counter for database nova_cell0 Jun 28 17:45:34.557010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writer thread running {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.557825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO dbcounter [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Registered counter for database nova_cell1 Jun 28 17:45:34.558366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writer thread running {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.565235 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_db.sqlalchemy.engines [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.567456 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_db.sqlalchemy.engines [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.573626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writer thread running {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.574889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writer thread running {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.708475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO dbcounter [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Registered counter for database nova_cell0 Jun 28 17:45:34.715411 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_db.sqlalchemy.engines [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.720259 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writer thread running {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:34.727692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO dbcounter [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Registered counter for database nova_cell0 Jun 28 17:45:34.734653 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_db.sqlalchemy.engines [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:45:34.740601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writer thread running {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:45:35.037337 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: WARNING keystonemiddleware.auth_token [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:45:35.045035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: WARNING keystonemiddleware.auth_token [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:45:35.068985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: WARNING keystonemiddleware.auth_token [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:45:35.076313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: WARNING keystonemiddleware.auth_token [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:45:35.390979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: WARNING keystonemiddleware.auth_token [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:45:35.397113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: WARNING keystonemiddleware.auth_token [None req-4e5c550f-42ea-4d50-9631-41efb9a902b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:45:35.403049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faec1d69c0 pid: 124336 (default app) Jun 28 17:45:35.422270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: WARNING keystonemiddleware.auth_token [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 17:45:35.428681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: WARNING keystonemiddleware.auth_token [None req-455da2b1-1771-46ba-b6a0-008c60f34482 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 17:45:35.434048 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faec1d69c0 pid: 124337 (default app) Jun 28 17:46:16.490553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:16.491428 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:16.492611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:16.493521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:17.073176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:17.074759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:17.075625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:17.076623 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:18.273748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bfd5058d-9c59-4302-b3ea-6175c88344b7 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Action: 'create', calling method: .version_select at 0x7f5774171280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1156938201", "metadata": {"Type": "work"}}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bfd5058d-9c59-4302-b3ea-6175c88344b7 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 122 Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:18.296925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1156938201", "metadata": {"Type": "work"}}} Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:18.299076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1156938201', 'metadata': {'Type': 'work'}}}} Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise error Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi '#$%' Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:18.300159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 17:46:18.303577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 17:46:18.305077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 17:46:18.305077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.306797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bfd5058d-9c59-4302-b3ea-6175c88344b7 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:18.307961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bfd5058d-9c59-4302-b3ea-6175c88344b7 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.838130 Jun 28 17:46:18.309108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 28 17:46:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1841 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:46:18.319454 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7c3dd37c-df4a-4128-851d-01f3bf4531b8 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Action: 'create', calling method: .version_select at 0x7f57740715e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-157210204", "metadata": {"Type": "work"}}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7c3dd37c-df4a-4128-851d-01f3bf4531b8 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 119 Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:18.324593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-157210204", "metadata": {"Type": "work"}}} Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:18.326254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-157210204', 'metadata': {'Type': 'work'}}}} Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise error Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi '0' Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:18.327220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 17:46:18.328889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 17:46:18.330288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 17:46:18.330288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.335300 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7c3dd37c-df4a-4128-851d-01f3bf4531b8 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:18.338952 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7c3dd37c-df4a-4128-851d-01f3bf4531b8 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024299 Jun 28 17:46:18.343240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 28 17:46:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:46:18.357111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-63f391fd-133b-47ad-9c82-f77875303a4f tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Action: 'create', calling method: .version_select at 0x7f57741714c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1504134456", "metadata": {"Type": "work"}}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-63f391fd-133b-47ad-9c82-f77875303a4f tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 119 Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:18.366380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1504134456", "metadata": {"Type": "work"}}} Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:18.368031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1504134456', 'metadata': {'Type': 'work'}}}} Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise error Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi '' Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:18.369003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 17:46:18.370451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 17:46:18.371931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 17:46:18.371931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:18.373610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-63f391fd-133b-47ad-9c82-f77875303a4f tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:18.374697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-63f391fd-133b-47ad-9c82-f77875303a4f tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026747 Jun 28 17:46:18.375751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 28 17:46:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 28 17:46:18.390273 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ce8e6083-4688-4637-86de-06491a7d81a5 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Calling method '.version_select at 0x7f5774022310>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:18.678713 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4061eab9-a0f7-4339-935f-b31c17f648b2 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Action: 'create', calling method: .version_select at 0x7f5774174280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1391197707", "metadata": {"Type": "work"}}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:19.789131 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-ce8e6083-4688-4637-86de-06491a7d81a5 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] HTTP exception thrown: Volume tempest-invalid-375494466 could not be found. Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ce8e6083-4688-4637-86de-06491a7d81a5 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-375494466 HTTP/1.1 Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:19.795243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Volume tempest-invalid-375494466 could not be found. Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'tempest-invalid-375494466'} Jun 28 17:46:19.796830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-375494466 could not be found. (HTTP 404) (Request-ID: req-6bfc7242-eb59-4539-8bc3-7c32894346a8) Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:19.797843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:46:19.800172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-375494466 could not be found. Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:46:19.801552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-375494466 could not be found. Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-375494466 could not be found. Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:19.802928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ce8e6083-4688-4637-86de-06491a7d81a5 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 404 to user: Volume tempest-invalid-375494466 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:19.805842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ce8e6083-4688-4637-86de-06491a7d81a5 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-375494466" status: 404 len: 98 microversion: 2.1 time: 1.424021 Jun 28 17:46:19.808741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1214 bytes} [Tue Jun 28 17:46:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-375494466 => generated 98 bytes in 1427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 28 17:46:19.819997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9f73e8b8-2474-4f6d-9ee7-05d3d840c916 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005966 Jun 28 17:46:19.822468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 5/5] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jun 28 17:46:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 28 17:46:19.834134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5a8a68a0-3fa2-4a70-8027-a91df15349f8 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004587 Jun 28 17:46:19.834857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1136 bytes} [Tue Jun 28 17:46:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 28 17:46:19.846032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-11b4c4c7-673a-4908-8488-893d99a322ba tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Calling method '.version_select at 0x7f5773fca700>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:20.261468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-11b4c4c7-673a-4908-8488-893d99a322ba tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] HTTP exception thrown: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-11b4c4c7-673a-4908-8488-893d99a322ba tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: DELETE /compute/v2.1/os-volumes/8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 HTTP/1.1 Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:20.266654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '8e3d19f4-e9b2-43c6-ab13-f4daf6a83532'} Jun 28 17:46:20.268860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. (HTTP 404) (Request-ID: req-89c61f64-3689-4eee-acad-c8eb0e8b8151) Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.269784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:46:20.270939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 17:46:20.271987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-11b4c4c7-673a-4908-8488-893d99a322ba tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 404 to user: Volume 8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-11b4c4c7-673a-4908-8488-893d99a322ba tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/8e3d19f4-e9b2-43c6-ab13-f4daf6a83532" status: 404 len: 109 microversion: 2.1 time: 0.430456 Jun 28 17:46:20.274394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 7/7] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:46:19 2022] DELETE /compute/v2.1/os-volumes/8e3d19f4-e9b2-43c6-ab13-f4daf6a83532 => generated 109 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:46:20.285577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-916ec4e3-70c5-4365-8262-30792e7d5121 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Calling method '.version_select at 0x7f5774071f70>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:20.659667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-916ec4e3-70c5-4365-8262-30792e7d5121 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] HTTP exception thrown: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-916ec4e3-70c5-4365-8262-30792e7d5121 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Request method failure captured: Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/os-volumes/97748742-f47b-4145-8072-1d887530732e HTTP/1.1 Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5oIqtzolGoOOY9igibt1H2LoxznYzRjK7SHcaWqBpQWnGd1BDHpcbYa-RXnEw73QL0J8wR4I3WCdryPHnI97hx6aeso_OAO9gP6uNWzzLoLnkl10Dyr0RAJOGp1qFUlDD8PxBuY3bjDAM_-uf7Z7NWARd4ZGjML7tdiBClNNki_KM Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:46:20.662993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_84e12df810544802a08dfc02895fb59c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/84e12df810544802a08dfc02895fb59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/84e12df810544802a08dfc02895fb59c"}]}] Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 84e12df810544802a08dfc02895fb59c Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesNegativeTest-1727004930 Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b7ad5dfd797a4a65b16a9ae591c1f540 Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesNegativeTest-1727004930-project Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '97748742-f47b-4145-8072-1d887530732e'} Jun 28 17:46:20.664661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. (HTTP 404) (Request-ID: req-87dce952-70ad-4bb3-8c8c-1766425d6d5d) Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.665564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:46:20.666631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 17:46:20.667677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-916ec4e3-70c5-4365-8262-30792e7d5121 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] Returning 404 to user: Volume 97748742-f47b-4145-8072-1d887530732e could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-916ec4e3-70c5-4365-8262-30792e7d5121 tempest-VolumesNegativeTest-1727004930 tempest-VolumesNegativeTest-1727004930-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/97748742-f47b-4145-8072-1d887530732e" status: 404 len: 109 microversion: 2.1 time: 0.385600 Jun 28 17:46:20.668779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 8/8] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:20 2022] GET /compute/v2.1/os-volumes/97748742-f47b-4145-8072-1d887530732e => generated 109 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:46:21.675382 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4061eab9-a0f7-4339-935f-b31c17f648b2 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.625610 Jun 28 17:46:21.676035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 1/9] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 28 17:46:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4629 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 28 17:46:21.688689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6a24fc23-5acc-46c5-9bd7-1bd9f0dfabeb tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5773fca160>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:21.882425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6a24fc23-5acc-46c5-9bd7-1bd9f0dfabeb tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 200 len: 353 microversion: 2.1 time: 0.198386 Jun 28 17:46:21.882999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 9/10] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:21 2022] GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:46:22.896270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6d9ecc16-a51f-4403-bfd5-50be7f5c055b tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5774049160>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:23.031513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6d9ecc16-a51f-4403-bfd5-50be7f5c055b tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 200 len: 354 microversion: 2.1 time: 0.140050 Jun 28 17:46:23.045301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 2/11] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:22 2022] GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:46:23.046739 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ae9a0988-a8fc-4e9a-9ecd-6288cfb9bb2b tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5774071a60>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:23.224550 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ae9a0988-a8fc-4e9a-9ecd-6288cfb9bb2b tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 200 len: 354 microversion: 2.1 time: 0.181919 Jun 28 17:46:23.225389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 10/12] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:23 2022] GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:46:23.247975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3db303c5-0745-4b36-99a9-3d37c5c97a9d tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5774049700>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:23.452193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3db303c5-0745-4b36-99a9-3d37c5c97a9d tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 202 len: 0 microversion: 2.1 time: 0.209987 Jun 28 17:46:23.453142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 3/13] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:46:23 2022] DELETE /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:46:23.465158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9206a6e7-8b37-4833-8a04-0a60ca8148bc tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5773fca790>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:23.628194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9206a6e7-8b37-4833-8a04-0a60ca8148bc tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 200 len: 353 microversion: 2.1 time: 0.168792 Jun 28 17:46:23.634040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 11/14] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:23 2022] GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:46:24.642142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e8b0e7cc-dddb-48f1-867e-4a1a592635d7 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Calling method '.version_select at 0x7f5774049940>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:24.704986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-e8b0e7cc-dddb-48f1-867e-4a1a592635d7 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] HTTP exception thrown: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e8b0e7cc-dddb-48f1-867e-4a1a592635d7 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Request method failure captured: Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf HTTP/1.1 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz5oxZsTXmAylvn9pGcKR7fs3s0tENIAC003NDlLHDdIvX1w9CfMhKDn_OQU2KTcHUQu0o3jkwVs3PAoueJwa2lU-4EUiRr3HWpm56_anVIn1pH1V4KNsQm8w5-q7btqik6DiHSh4BUojdFRljJgCxAEyOwaaOH4hBuocRx8MOt9Z3s Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: c8994507557045749f8ab693fd06b2c5 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-VolumesGetTestJSON-1975981154 Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:46:24.710426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8994507557045749f8ab693fd06b2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8994507557045749f8ab693fd06b2c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8994507557045749f8ab693fd06b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8994507557045749f8ab693fd06b2c5"}]}] Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-VolumesGetTestJSON-1975981154 Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: c8994507557045749f8ab693fd06b2c5 Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-VolumesGetTestJSON-1975981154 Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-VolumesGetTestJSON-1975981154-project Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: b6c1f05ae28a43329848f347b379747d Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-VolumesGetTestJSON-1975981154-project Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '186a5d5f-dae6-419c-b0b5-7b673b3672cf'} Jun 28 17:46:24.711441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. (HTTP 404) (Request-ID: req-d2002f8f-913d-4de0-8815-935140b68568) Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:24.712112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:46:24.712960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 17:46:24.714479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e8b0e7cc-dddb-48f1-867e-4a1a592635d7 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] Returning 404 to user: Volume 186a5d5f-dae6-419c-b0b5-7b673b3672cf could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:46:24.715690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e8b0e7cc-dddb-48f1-867e-4a1a592635d7 tempest-VolumesGetTestJSON-1975981154 tempest-VolumesGetTestJSON-1975981154-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf" status: 404 len: 109 microversion: 2.1 time: 0.074374 Jun 28 17:46:24.729520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 4/15] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:46:24 2022] GET /compute/v2.1/os-volumes/186a5d5f-dae6-419c-b0b5-7b673b3672cf => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:46:27.174204 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7e2622ec-bbb0-4815-9d63-7b6c9e8e4e79 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: .version_select at 0x7f5773fca310>, body: {"keypair": {"name": "tempest-keypair-605740161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmh50m0GcvxkuvclReCzpfj+U2+2s9TynKvqTs7uEs6LLHt9Jrr1G2RCZys3R4BNBNhpocRpqCg5wdRSq5kTY0Xw6INSWdlU35iEHvHHypomALT+vPyjZS5BeEHVHk9yA=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:27.316437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-7e2622ec-bbb0-4815-9d63-7b6c9e8e4e79 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for project 2f62aa1a154c498fbda7643ae9180098. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:46:27.338544 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-7e2622ec-bbb0-4815-9d63-7b6c9e8e4e79 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for user 77c37b0691e94ef784ee377e7ebfd6ef and project 2f62aa1a154c498fbda7643ae9180098. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:46:27.485339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7e2622ec-bbb0-4815-9d63-7b6c9e8e4e79 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.665556 Jun 28 17:46:27.488568 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 12/16] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:46:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:46:31.585746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-717660680", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:31.940498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] validate_networks() for [('91b4b64c-5ea4-45a1-88c6-446aed9004ce', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:46:34.071820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-114019389", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d1894c1-8b2c-45b7-9682-725f5d8a25f4"}], "security_groups": [{"name": "tempest-securitygroup--156325523"}], "key_name": "tempest-keypair-605740161", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:34.579799 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] validate_networks() for [('9d1894c1-8b2c-45b7-9682-725f5d8a25f4', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:46:35.927566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:46:35.929595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:46:35.932141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:46:35.933305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:46:35.951640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:46:36.002040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:36.011339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:36.013853 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:36.015505 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:36.164085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:46:36.196479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for user 3a8c23b156174db28359e9f93c7378c8 and project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:46:36.270112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:46:36.282342 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:46:36.569453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-568f74ab-fa2e-427d-ac0a-dd781122e653 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.709760 Jun 28 17:46:36.576470 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 5/17] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:46:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 5711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:46:36.584564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f11ec82d-bef5-458c-86e1-d4ad54fd8f53 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:36.585225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f11ec82d-bef5-458c-86e1-d4ad54fd8f53 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:36.858879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f11ec82d-bef5-458c-86e1-d4ad54fd8f53 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:36.880111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f11ec82d-bef5-458c-86e1-d4ad54fd8f53 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1221 microversion: 2.1 time: 0.299361 Jun 28 17:46:36.882193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 6/18] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:36 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1221 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:37.374817 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=4 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:38.309898 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:46:38.310656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:46:38.311495 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:46:38.312236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:46:38.314330 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:46:38.356829 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:38.357480 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:38.358919 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:38.359657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:38.429004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for project 2f62aa1a154c498fbda7643ae9180098. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:46:38.443334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for user 77c37b0691e94ef784ee377e7ebfd6ef and project 2f62aa1a154c498fbda7643ae9180098. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:46:38.471461 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:46:38.478580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:46:38.660467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b4065a55-cade-432d-a4e4-99fe4b9ae397 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.596867 Jun 28 17:46:38.663620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 13/19] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:46:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 4602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:46:38.681807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-769192026", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:38.808544 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] validate_networks() for [('91b4b64c-5ea4-45a1-88c6-446aed9004ce', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:46:38.854360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1796742379", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "networks": [{"uuid": "7accca01-0894-44bd-8f35-49e4b2b78e2b"}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:39.031040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] validate_networks() for [('7accca01-0894-44bd-8f35-49e4b2b78e2b', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:46:39.860265 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:46:39.861989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:46:39.863152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:46:39.864117 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:46:39.865575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:46:39.890581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:39.891818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:39.894943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:39.897007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:39.950884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:46:39.965317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for user 3a8c23b156174db28359e9f93c7378c8 and project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:46:39.998627 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:46:40.005037 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:46:40.200729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dccdd25d-6c6d-440b-af8a-44193d7285a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.530266 Jun 28 17:46:40.204934 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 14/20] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:46:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:46:40.232927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-61436694-2fdf-46ca-b2eb-198881728e87 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:40.234509 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-61436694-2fdf-46ca-b2eb-198881728e87 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:40.696547 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-61436694-2fdf-46ca-b2eb-198881728e87 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:40.730141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:46:40.731941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:46:40.734169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:46:40.734833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:46:40.735438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:46:40.771707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:40.775345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:40.779926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:40.781073 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-61436694-2fdf-46ca-b2eb-198881728e87 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1236 microversion: 2.1 time: 0.569749 Jun 28 17:46:40.785487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 15/21] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:40 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1236 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:40.801279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:40.849592 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d9c809aa-2070-46fd-af70-5f2137770542 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:40.852152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d9c809aa-2070-46fd-af70-5f2137770542 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:40.876803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Getting quotas for project 5c59df85f40d4146ae0b7180ca9034d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:46:40.891792 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Getting quotas for user ed055062d3e7415bbc409e5bb8109cab and project 5c59df85f40d4146ae0b7180ca9034d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:46:40.938720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:46:40.944739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:46:41.165484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-43e4dbab-f876-4a93-b15e-2da4c2d23158 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.719591 Jun 28 17:46:41.177633 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 7/22] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:46:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:46:41.205040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3c8fbb55-0a54-4121-a9cb-a48928405333 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:41.209526 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3c8fbb55-0a54-4121-a9cb-a48928405333 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:41.470203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d9c809aa-2070-46fd-af70-5f2137770542 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:41.524056 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3c8fbb55-0a54-4121-a9cb-a48928405333 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:41.543791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3c8fbb55-0a54-4121-a9cb-a48928405333 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1215 microversion: 2.1 time: 0.354228 Jun 28 17:46:41.550270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d9c809aa-2070-46fd-af70-5f2137770542 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1221 microversion: 2.1 time: 0.729481 Jun 28 17:46:41.565498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 8/23] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:41 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:41.573614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 16/24] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:40 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1221 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:41.816472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-af96236e-ef80-4239-ace8-48cdfca66f31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:41.817804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-af96236e-ef80-4239-ace8-48cdfca66f31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:42.212252 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-af96236e-ef80-4239-ace8-48cdfca66f31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:42.254254 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-af96236e-ef80-4239-ace8-48cdfca66f31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1236 microversion: 2.1 time: 0.437174 Jun 28 17:46:42.262166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 9/25] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:41 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1236 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:42.570728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f1661cd9-044c-492c-b41d-04f93a9676ef tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:42.571605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f1661cd9-044c-492c-b41d-04f93a9676ef tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:42.572157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:42.572949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:42.608305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:42.610625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:42.618434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:42.621387 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:42.798788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f1661cd9-044c-492c-b41d-04f93a9676ef tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:42.825406 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f1661cd9-044c-492c-b41d-04f93a9676ef tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1215 microversion: 2.1 time: 0.259820 Jun 28 17:46:42.832831 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 17/26] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:42 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:43.287863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-452546cf-8577-4640-986e-551f2ed4117f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:43.291206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-452546cf-8577-4640-986e-551f2ed4117f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:43.946163 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:43.953755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-452546cf-8577-4640-986e-551f2ed4117f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:43.970128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-452546cf-8577-4640-986e-551f2ed4117f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1236 microversion: 2.1 time: 0.689844 Jun 28 17:46:43.974120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 18/27] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:43 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1236 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:43.991035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-33d69129-e011-46ff-a7a7-6b6ecec5b53e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:43.992518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-33d69129-e011-46ff-a7a7-6b6ecec5b53e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:44.030482 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d6b56949-8b28-4dc2-84e7-e10b8cae6e12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1225 microversion: 2.1 time: 1.457453 Jun 28 17:46:44.048220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 10/28] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:42 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1225 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:44.355505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-33d69129-e011-46ff-a7a7-6b6ecec5b53e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:44.370439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-33d69129-e011-46ff-a7a7-6b6ecec5b53e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1215 microversion: 2.1 time: 0.395073 Jun 28 17:46:44.388556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 19/29] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:43 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:45.006815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:45.010905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:45.066376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:45.072577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:45.099487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.105586 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.111944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.135119 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.153589 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.159510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.167151 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.167910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.660110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:45.678719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bc936d90-19a6-4d5e-842d-49a998ba800e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1232 microversion: 2.1 time: 0.678681 Jun 28 17:46:45.692980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 11/30] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:44 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1232 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:45.729824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:45.734761 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:45.764881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.767942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.773473 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:45.774675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:45.998849 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:46.019521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fc24cb5b-4390-4b57-85e1-0ad4c967f3f7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1281 microversion: 2.1 time: 0.960582 Jun 28 17:46:46.025632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 20/31] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:45 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1281 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:46.329384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:46.347572 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d9173ece-5b0a-493d-9c1a-a3b5d1345b61 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1267 microversion: 2.1 time: 0.646688 Jun 28 17:46:46.349978 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 12/32] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:45 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1267 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:46.697154 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:46.698516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:46.711514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:46.712178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:46.713263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:46.714023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:46.990433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:47.005627 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a26278fc-25f7-472c-a34b-34a466fe080e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1296 microversion: 2.1 time: 0.312505 Jun 28 17:46:47.013212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 21/33] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:46 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1296 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:47.057759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:47.067431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:47.100045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:47.111728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:47.113679 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:47.114464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:47.376475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:47.377702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:47.402380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:47.402800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:47.404256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:47.405080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:47.651987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:47.692716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c3151a3d-9c03-4886-bb40-f90b599b70e5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1279 microversion: 2.1 time: 0.634757 Jun 28 17:46:47.694450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 13/34] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:47 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1279 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:48.050826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:48.058576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:48.099256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:48.100024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:48.101502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:48.102296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:48.167277 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:48.226065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ac9b8361-30b0-4f30-bde2-d1e2adf2a460 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1273 microversion: 2.1 time: 0.844215 Jun 28 17:46:48.233285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 22/35] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:47 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1273 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:48.607127 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:48.645539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-edb1237f-ef48-4dce-9538-6b3143ecafaa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1294 microversion: 2.1 time: 0.607693 Jun 28 17:46:48.648122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 14/36] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:48 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1294 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:48.733628 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:48.740312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:48.776754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:48.777792 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:48.779968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:48.781561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:49.271166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:49.273351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:49.295974 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:49.296754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:49.298201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:49.303450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:49.476346 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:49.505760 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b8d829db-b114-4364-b252-b986e1064fef tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.784001 Jun 28 17:46:49.519567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 23/37] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:48 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:49.641558 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:49.680159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:49.681214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:49.696044 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a00900bd-90d0-4501-9f51-d19189e3516e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1273 microversion: 2.1 time: 0.428955 Jun 28 17:46:49.697688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:49.698155 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:49.704632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 15/38] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:49 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:49.707786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:49.708258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:49.924969 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=4 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:50.029257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:50.098084 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-21cf18e0-b6d8-4f0d-804b-879a017aee77 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1294 microversion: 2.1 time: 0.421226 Jun 28 17:46:50.099765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 24/39] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:49 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1294 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:50.530735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:50.531871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:50.565165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:50.565923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:50.567076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:50.578374 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:50.726875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:50.754816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:50.828696 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:50.832616 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:50.833340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:50.834659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:50.836577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:51.432668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:51.446795 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7bcde614-a89c-4734-9a13-4244a818f8a6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.923391 Jun 28 17:46:51.468655 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 16/40] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:50 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:51.494875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:51.500417 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:51.521887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:51.525247 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:51.527701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:51.532142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:51.813262 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:51.867938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2b6ca6d2-6f2a-44cc-a904-1e1c48b7381e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1294 microversion: 2.1 time: 0.388288 Jun 28 17:46:51.887386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 17/41] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:51 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1294 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:52.071221 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:52.103344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-44aa8d77-3ed4-4e2d-8dfd-6ee413abcca2 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 1.384480 Jun 28 17:46:52.105614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 25/42] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:50 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:52.472189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:52.480930 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:52.484084 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=18 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:52.513721 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:52.516832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:52.520548 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:52.527208 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:52.916525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:52.932530 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:52.965485 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:52.969572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:52.973664 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:53.014202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:53.266178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:53.275681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fc2e52ea-bace-47f5-8475-ac3a2b9dcca7 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.810665 Jun 28 17:46:53.282819 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 18/43] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:52 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:53.294838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:53.298218 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:53.314549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:53.318942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:53.320365 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:53.321355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:53.558659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:53.597050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8f4d3730-ce13-4bc9-a9d2-9a5ed1c02fa1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1294 microversion: 2.1 time: 0.695098 Jun 28 17:46:53.606439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 26/44] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:52 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1294 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:54.185553 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:54.212293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3ac370e8-f2e2-4c10-90cb-c78021174b76 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.927266 Jun 28 17:46:54.213408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 19/45] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:53 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:54.317594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:54.320834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:54.348158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:54.353621 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:54.355803 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:54.357413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:54.379820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=22 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:54.628678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:54.630455 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:54.654486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:54.656806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:54.657814 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:54.658280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:55.813070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:55.825591 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c1e740c1-6726-4857-8bfb-dd5569a5fa2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 1.202197 Jun 28 17:46:55.829298 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 20/46] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:54 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:55.846399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:55.847393 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:55.875790 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:55.876396 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:55.877320 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:55.877825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:56.479477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:56.507356 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1a1dffa7-d244-4ad2-83b6-2b45762411cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 2.190104 Jun 28 17:46:56.522309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 27/47] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:54 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:56.863110 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:56.864168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:56.883450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:56.888491 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:56.891899 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:56.896742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:56.897943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.104145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:57.121309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5518abbd-7a1c-4e57-80a6-c4d1ac5c8215 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 1.289231 Jun 28 17:46:57.122546 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 21/48] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:55 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:57.338805 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-658a8043-729e-46d5-99b3-50a7697f6e5b req-83a321b0-9dab-4734-b8cf-1aaf8686e2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf62a85-c4fd-4de1-8b36-5868f2a1fede", "tag": "d8954c8e-6ae5-494d-8929-f95f1dcd8ca0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:57.362715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-658a8043-729e-46d5-99b3-50a7697f6e5b req-83a321b0-9dab-4734-b8cf-1aaf8686e2b0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:57.363873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-658a8043-729e-46d5-99b3-50a7697f6e5b req-83a321b0-9dab-4734-b8cf-1aaf8686e2b0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.407859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-658a8043-729e-46d5-99b3-50a7697f6e5b req-83a321b0-9dab-4734-b8cf-1aaf8686e2b0 service nova] Creating event network-changed:d8954c8e-6ae5-494d-8929-f95f1dcd8ca0 for instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede on hv-cinder-84801 Jun 28 17:46:57.409217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-658a8043-729e-46d5-99b3-50a7697f6e5b req-83a321b0-9dab-4734-b8cf-1aaf8686e2b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 17:46:57.411581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:57.412678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.414739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:57.415740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.435633 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.compute.rpcapi [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 17:46:57.437807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] Releasing lock "compute-rpcapi-router" {{(pid=124337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 17:46:57.511723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6b9ff71f-c8c9-460a-ae10-3480957f8963 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302368 Jun 28 17:46:57.513514 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 22/49] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:46:57.536616 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:57.537877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:57.552107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:57.553009 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.555925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:57.557867 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:57.953547 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:57.968169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7f356c54-06a5-487a-9fcc-9ad7f5c51b3f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 1.111971 Jun 28 17:46:57.974720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:56 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:58.135563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:58.152236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:58.154395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ab95531e-24a1-4c18-8832-1a73e066d46f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.622087 Jun 28 17:46:58.156256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:58.168553 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 23/51] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:57 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:58.182611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:58.193422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:58.194332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:58.207420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.015204 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:59.028648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5c4c9ea6-4509-4336-a7a0-3b7f2ed61d66 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.884863 Jun 28 17:46:59.048087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 29/52] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:58 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:46:59.072211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:59.073754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:59.088272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.095055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.096325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.097079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.100506 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-394f149a-020f-4bf3-8202-9f96720cd24c req-3c5829e6-1e4c-435a-9eb1-385b6bd8c084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e", "tag": "993cf18a-c58f-496d-b680-d71128ef3f26"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:59.129353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-394f149a-020f-4bf3-8202-9f96720cd24c req-3c5829e6-1e4c-435a-9eb1-385b6bd8c084 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.135654 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-394f149a-020f-4bf3-8202-9f96720cd24c req-3c5829e6-1e4c-435a-9eb1-385b6bd8c084 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.186487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-394f149a-020f-4bf3-8202-9f96720cd24c req-3c5829e6-1e4c-435a-9eb1-385b6bd8c084 service nova] Creating event network-changed:993cf18a-c58f-496d-b680-d71128ef3f26 for instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e on hv-cinder-84801 Jun 28 17:46:59.209688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-394f149a-020f-4bf3-8202-9f96720cd24c req-3c5829e6-1e4c-435a-9eb1-385b6bd8c084 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.629601 Jun 28 17:46:59.212889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 24/53] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:46:59.238232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:46:59.239048 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:46:59.261264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.261986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.263581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.264283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.537811 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:59.577162 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-370a208f-c025-431f-a3d7-4472cf8cf6f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.522382 Jun 28 17:46:59.579522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 30/54] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:59 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:59.643964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:46:59.647728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-8835c58d-ec50-4d64-a4fb-ad982286c87a req-eecff3ce-f280-4c60-9465-22410d1c5439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427293a6-e0fd-4178-9bff-2277df234adb", "tag": "dfe9a6f3-14fe-4241-94d3-47544bb83c60"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:46:59.668151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-441a6967-6f92-488c-9c8c-c2c5a0810102 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.446141 Jun 28 17:46:59.692931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 25/55] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:46:59 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:46:59.693893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8835c58d-ec50-4d64-a4fb-ad982286c87a req-eecff3ce-f280-4c60-9465-22410d1c5439 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.694823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8835c58d-ec50-4d64-a4fb-ad982286c87a req-eecff3ce-f280-4c60-9465-22410d1c5439 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.737414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-8835c58d-ec50-4d64-a4fb-ad982286c87a req-eecff3ce-f280-4c60-9465-22410d1c5439 service nova] Creating event network-changed:dfe9a6f3-14fe-4241-94d3-47544bb83c60 for instance 427293a6-e0fd-4178-9bff-2277df234adb on hv-cinder-84801 Jun 28 17:46:59.741367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8835c58d-ec50-4d64-a4fb-ad982286c87a req-eecff3ce-f280-4c60-9465-22410d1c5439 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 17:46:59.742940 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.743851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.745288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:46:59.746718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:46:59.763939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.compute.rpcapi [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 17:46:59.765109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] Releasing lock "compute-rpcapi-router" {{(pid=124336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 17:46:59.805813 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bdda52f8-2850-47b2-b5c3-e99bc19ad1ec None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198762 Jun 28 17:46:59.807454 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 31/56] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:00.060658 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:00.062101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:00.085066 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.086374 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.088084 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.089188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.410087 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:00.416752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:00.433857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1f8bc645-f0fd-4ae9-975e-65d2ad98d0b7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.382298 Jun 28 17:47:00.434719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 26/57] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:00 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:00.603575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:00.605425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:00.615127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.615785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.616870 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.617499 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.701476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:00.704914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:00.743920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.749551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.751471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:00.753448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:00.879815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:00.896158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8ff62594-1c4b-43fe-957c-70792daf2bff tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.297093 Jun 28 17:47:00.897612 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 32/58] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:00 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:01.119286 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:01.135950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a4cfd0f4-bdf1-4808-a931-bf35fd10ebdc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.442965 Jun 28 17:47:01.137530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:00 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:01.253202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-92069088-3620-44b2-9602-bb8890d4a969 req-cd063f03-a325-4979-9b99-b5cba719913f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc", "tag": "553daf34-1a16-4c07-b5ee-f59783300d84"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:01.278964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-92069088-3620-44b2-9602-bb8890d4a969 req-cd063f03-a325-4979-9b99-b5cba719913f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:01.280144 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-92069088-3620-44b2-9602-bb8890d4a969 req-cd063f03-a325-4979-9b99-b5cba719913f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:01.310284 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-92069088-3620-44b2-9602-bb8890d4a969 req-cd063f03-a325-4979-9b99-b5cba719913f service nova] Creating event network-changed:553daf34-1a16-4c07-b5ee-f59783300d84 for instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc on hv-cinder-84801 Jun 28 17:47:01.343371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-92069088-3620-44b2-9602-bb8890d4a969 req-cd063f03-a325-4979-9b99-b5cba719913f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098706 Jun 28 17:47:01.349375 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 33/60] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:01.464928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:01.468041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:01.492264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:01.502088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:01.502823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:01.519313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:01.525477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:01.926373 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:01.941217 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:02.018517 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:02.025577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:02.034036 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:02.038469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:02.538521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:02.551622 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7a35c06d-3740-476e-994a-be84fe1b1997 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 1.100076 Jun 28 17:47:02.552469 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 28/61] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:01 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:02.569225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:02.569933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:02.582887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:02.584366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:02.586399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:02.587703 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:03.206154 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:03.217381 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b96151d7-c0d7-4853-983a-0a305e42ca57 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 1.305743 Jun 28 17:47:03.225003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 34/62] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:01 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:03.414563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:03.442599 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2cbd7056-c2e3-4414-be52-75176a608a49 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.885422 Jun 28 17:47:03.491424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 29/63] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:02 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:03.587594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:03.588506 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:03.597058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:03.597905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:03.598962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:03.599637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:04.247668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:04.251071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:04.289462 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:04.293681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:04.298811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:04.309588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:04.788130 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:04.833301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ba1c5815-a78a-48f7-bb63-852cefbfe8c5 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 1.259259 Jun 28 17:47:04.860800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 35/64] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:03 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:04.884459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:04.887154 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:04.932607 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:04.936155 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:04.947920 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:04.950673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:05.208626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:05.249464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e4c5f688-6cc0-478e-8094-7e04ac406a10 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 1.009014 Jun 28 17:47:05.268870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 30/65] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:04 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:05.863041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:05.867349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:05.900316 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:05.907762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:05.909855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:05.911693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:06.249293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:06.294043 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:06.336699 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-03594a0d-2e22-426f-8edb-c981014ddb6a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 1.469743 Jun 28 17:47:06.345072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 36/66] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:04 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:06.365557 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:06.369820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:06.402279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:06.403679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:06.406460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:06.410997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:06.886023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:06.919128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-78550123-66c0-4bcb-b7bd-94582273ea74 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 1.064708 Jun 28 17:47:06.926607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 31/67] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:05 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:07.039185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:07.047872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-59427863-8522-4492-8606-6f443c0e4490 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.699223 Jun 28 17:47:07.049094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 37/68] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:06 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:07.366006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:07.367516 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:07.381691 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:07.382849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:07.385755 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:07.386757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:07.436324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:07.897604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:07.909672 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fa6af1fa-3cf8-4e22-b5e3-c6b109e86958 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.550187 Jun 28 17:47:07.920108 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 32/69] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:07 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:07.961232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:07.965344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:07.977106 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:07.978042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:07.979745 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:07.981009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:08.084565 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:08.085917 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:08.102166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:08.103400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:08.106042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:08.106042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:08.261708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:08.285966 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-55185bdd-e212-4860-9165-a09d29d4ac40 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.338972 Jun 28 17:47:08.286970 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 38/70] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:07 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:08.376418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:08.394172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-32ce57f8-6772-4b5b-acb9-0f4e4c880cc2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.320673 Jun 28 17:47:08.395327 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 33/71] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:08 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:08.930373 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:08.931887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:08.940706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:08.942370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:08.943669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:08.944510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:09.306600 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:09.308022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:09.322675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:09.327619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:09.330691 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:09.331410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:09.383472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:09.396611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c5855545-0429-466b-acf5-c065056c3b77 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.471000 Jun 28 17:47:09.401316 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 39/72] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:08 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:09.430385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:09.431598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:09.444859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:09.449749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:09.450967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:09.451788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:09.768076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:09.886003 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:09.929149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-984c1890-ef42-46f8-bda5-972a80ac2b44 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.626883 Jun 28 17:47:09.952879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 34/73] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:09 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:09.990590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:10.026894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d7d8ede7-fc9d-4dbe-a32e-8410aa80f526 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.600444 Jun 28 17:47:10.027872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 40/74] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:09 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:10.429983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:10.430678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:10.445100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:10.445603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:10.446434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:10.447283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:10.673083 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:10.685786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-730a8eda-3f41-443f-bbda-379c7b92cf8a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.260566 Jun 28 17:47:10.686924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 35/75] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:10 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:10.965301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:10.966579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:11.011777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.014293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.015985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.017173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.053612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:11.054715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:11.070528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.071290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.072267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.072950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.313170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:11.322139 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:11.328082 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9a2add25-c314-46d5-8268-7e8df316f3d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.278440 Jun 28 17:47:11.330014 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 36/76] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:11 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:11.345645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-32415914-30d9-4811-b069-dda1b6248778 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.389043 Jun 28 17:47:11.346715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 41/77] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:10 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:11.727363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:11.729352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:11.737176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.737754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.749513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:11.750757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:11.987071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:11.996538 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-20475617-2fce-4425-b2ab-a7fb517f3c44 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.286573 Jun 28 17:47:12.004453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 37/78] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:11 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:12.355518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:12.356914 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:12.381220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:12.389434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:12.406525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:12.409176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:12.411726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:12.413315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:12.426507 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:12.427174 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:12.429177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:12.432147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:12.832886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:12.848891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-839ca919-8dda-4fea-ab8d-67b7b01bcb62 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.498722 Jun 28 17:47:12.850625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 42/79] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:12 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:12.926479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:12.941909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a858e367-6340-4d86-b6c5-a3c00ddde5b1 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.574017 Jun 28 17:47:12.942850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:12 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:13.024105 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:13.025586 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:13.036758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.036758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:13.037430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.038331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:13.295134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:13.306358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-24cd5e06-88f5-4a05-a544-f5edb79eddb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.294303 Jun 28 17:47:13.308981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 43/81] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:13 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:13.873899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:13.875152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:13.886356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.887163 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:13.888549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.889296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:13.966646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:13.967777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:13.986049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.987370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:13.989122 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:13.990208 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:14.201158 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:14.222142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8de6fda2-d9b1-4070-9cb0-90bc6b39f8eb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.349720 Jun 28 17:47:14.222142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 39/82] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:13 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:14.299784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:14.310703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5a90d2cd-b8db-4cfd-909b-defc64274ec9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.354267 Jun 28 17:47:14.311501 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:13 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:14.334875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:14.335720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:14.344798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:14.345719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:14.347071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:14.347781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:14.572270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:14.581467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8472384b-3ed6-4dad-b3b5-c224c6ae4d0c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.251265 Jun 28 17:47:14.588701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:14 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:15.246651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:15.248031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:15.256800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.257356 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.258244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.258768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.334740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:15.337142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:15.351845 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.353238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.355185 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.356240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.671275 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:15.687006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a344d3ed-949d-49c3-a4bc-91dc8ead6242 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.357721 Jun 28 17:47:15.689729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 41/85] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:15 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:15.700554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:15.702328 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:15.714112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.715003 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.716797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:15.717752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:15.919188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:15.945720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6dd14a3f-f30e-4f1e-8eba-2fbe759d581a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.709080 Jun 28 17:47:15.947863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 45/86] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:15 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:16.011014 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:16.023819 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3de86697-e87e-4ca0-bffa-2851bb735a55 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.331987 Jun 28 17:47:16.025363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 42/87] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:15 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:16.752001 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:16.754159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:16.790457 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:16.791163 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:16.796323 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:16.797025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:16.979179 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:16.980417 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:16.995915 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:16.996519 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:16.999665 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:17.000091 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:17.037345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:17.315992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:17.345687 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-df8e0f65-eac1-4186-a8ca-24c49ff96ae0 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.620017 Jun 28 17:47:17.346907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 46/88] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:16 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:17.381435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:17.382398 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:17.403062 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:17.404167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:17.405890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:17.406982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:17.669590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:17.682341 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-efc4b92f-5a85-46d1-bd05-fbfefcd97ee1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.320119 Jun 28 17:47:17.695009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 47/89] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:17 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:18.125954 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:18.144199 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a93da8ae-beb2-4b61-9bc5-f991bdba9110 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 1.174413 Jun 28 17:47:18.146919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 43/90] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:16 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:18.380769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:18.382041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:18.394519 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:18.395691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:18.397117 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:18.397830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:18.710799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:18.716321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:18.741075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:18.749794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:18.755810 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:18.755962 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:18.919876 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:18.953830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9eaca81b-3161-4b5c-86e1-761f03d5f8c7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.579376 Jun 28 17:47:18.954897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:18 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:19.172896 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:19.176507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:19.200212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:19.206625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:19.209498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:19.212712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:19.319277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:19.339159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-764e4b30-1da9-4e4a-92bf-34c63f09ef4b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.639788 Jun 28 17:47:19.340997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 44/92] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:18 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:19.588700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:19.612072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0a417f31-e7ca-4100-9ce7-9b6c1afa9161 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.446868 Jun 28 17:47:19.613640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 49/93] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:19 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:19.988696 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:19.990349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:20.005820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.007333 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.009589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.010814 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.342253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:20.363388 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3278fcc1-aa26-44b6-9e2e-62805b73e24d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.383996 Jun 28 17:47:20.366882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:19 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:20.378169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:20.384512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:20.403911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.407549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.411779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.415875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.641133 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:20.643139 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:20.690690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.709751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.711327 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:20.712838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:20.853971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:20.874169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f530a643-1ac8-4ddb-81ed-882ec3b49f64 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.513221 Jun 28 17:47:20.893436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 50/95] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:20 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:21.151501 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:21.165160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c0d5c5b3-0f5c-460b-bfaf-5b75adf8ad5e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.533794 Jun 28 17:47:21.168434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 46/96] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:20 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:21.407115 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:21.408802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:21.427049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:21.427977 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:21.431897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:21.432961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:21.763090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:21.777381 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b2f5b04d-3d1c-4ecb-89a6-0d0072758026 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.385198 Jun 28 17:47:21.779379 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 51/97] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:21 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:21.898249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-5099fe0d-8c8e-410d-b241-49199ec25f60 req-3adc12ef-3da5-43c2-8910-f257ee7c5beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e", "name": "network-vif-plugged", "status": "completed", "tag": "993cf18a-c58f-496d-b680-d71128ef3f26"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:21.904875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:21.905705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:21.912632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5099fe0d-8c8e-410d-b241-49199ec25f60 req-3adc12ef-3da5-43c2-8910-f257ee7c5beb service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:21.913376 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5099fe0d-8c8e-410d-b241-49199ec25f60 req-3adc12ef-3da5-43c2-8910-f257ee7c5beb service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:21.919936 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:21.920373 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:21.924756 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:21.925451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:21.937224 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-5099fe0d-8c8e-410d-b241-49199ec25f60 req-3adc12ef-3da5-43c2-8910-f257ee7c5beb service nova] Creating event network-vif-plugged:993cf18a-c58f-496d-b680-d71128ef3f26 for instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e on hv-cinder-84801 Jun 28 17:47:21.946752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-5099fe0d-8c8e-410d-b241-49199ec25f60 req-3adc12ef-3da5-43c2-8910-f257ee7c5beb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.483092 Jun 28 17:47:21.948510 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 47/98] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:47:22.209338 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:22.219261 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:22.241725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:22.248668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:22.253237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:22.254638 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:22.261376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:22.278175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d6652f2e-7004-48cc-ae9c-c08a93e743ab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.376808 Jun 28 17:47:22.292452 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 52/99] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:21 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:22.633566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:22.674762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-90d3bd6e-27fc-4f8f-92ab-15dc6425a4a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.477846 Jun 28 17:47:22.675650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 48/100] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:22 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:22.804235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:22.805160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:22.812438 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:22.813189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:22.814986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:22.815741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:22.839297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:23.004769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:23.014156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0d574d47-0b80-48e1-a0f2-8fa48b5e4d25 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.213850 Jun 28 17:47:23.015601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 53/101] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:22 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:23.310982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:23.313421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:23.326217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:23.327446 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:23.329279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:23.330413 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:23.697907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:23.698742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:23.710793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:23.713405 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:23.716045 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:23.719626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:23.826055 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:23.848290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e6222b1a-1cab-4f79-9b8a-dd7ef82c490a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.544844 Jun 28 17:47:23.858921 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 49/102] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:23 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:23.984049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf62a85-c4fd-4de1-8b36-5868f2a1fede", "name": "network-vif-plugged", "status": "completed", "tag": "d8954c8e-6ae5-494d-8929-f95f1dcd8ca0"}, {"server_uuid": "427293a6-e0fd-4178-9bff-2277df234adb", "name": "network-vif-plugged", "status": "completed", "tag": "dfe9a6f3-14fe-4241-94d3-47544bb83c60"}, {"server_uuid": "9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc", "name": "network-vif-plugged", "status": "completed", "tag": "553daf34-1a16-4c07-b5ee-f59783300d84"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:24.026193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:24.027142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:24.058144 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:24.082300 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-05275ec9-d54b-478a-a826-f22b0d8ebc5d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.388355 Jun 28 17:47:24.083337 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 54/103] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:23 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:24.089237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Creating event network-vif-plugged:d8954c8e-6ae5-494d-8929-f95f1dcd8ca0 for instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede on hv-cinder-84801 Jun 28 17:47:24.089782 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Creating event network-vif-plugged:dfe9a6f3-14fe-4241-94d3-47544bb83c60 for instance 427293a6-e0fd-4178-9bff-2277df234adb on hv-cinder-84801 Jun 28 17:47:24.090285 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] Creating event network-vif-plugged:553daf34-1a16-4c07-b5ee-f59783300d84 for instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc on hv-cinder-84801 Jun 28 17:47:24.106757 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:24.108466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:24.118099 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-65e8e34a-fff4-40eb-a7e0-ad949ebd172e req-7aedf726-e207-4cb0-9d8b-b1b448b6966e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.147193 Jun 28 17:47:24.122774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:24.123066 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 50/104] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:24.124289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:24.128040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:24.129233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:24.419947 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:24.434657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3949ec92-594f-4854-86ea-5200dabdccdf tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1315 microversion: 2.1 time: 0.341060 Jun 28 17:47:24.435271 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 55/105] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:24 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:24.873834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:24.877254 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:24.887520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:24.888375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:24.889446 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:24.890938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:25.100954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:25.102591 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:25.131950 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:25.132864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:25.134256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:25.134985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:25.268827 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:25.318380 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a7a57d7d-fec7-424c-8eb5-5dbd6e5437b8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.450065 Jun 28 17:47:25.323364 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 51/106] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:24 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:25.455375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:25.456317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:25.503328 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:25.507671 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:25.512243 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:25.516341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:25.546269 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:25.558599 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-685dd608-222e-4b9e-b6e0-c1d2da51f582 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.460325 Jun 28 17:47:25.569668 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 56/107] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:25 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:25.800114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:25.810443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c70e7b3d-4a26-47c3-ad8c-4ce13c99ab8e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1502 microversion: 2.1 time: 0.361218 Jun 28 17:47:25.811274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 52/108] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:25 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1502 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:26.339980 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:26.340782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:26.374525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:26.375584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:26.380240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:26.381632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:26.576653 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:26.577221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:26.585738 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:26.585972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:26.592972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:26.593677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:26.853139 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:26.873271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a761a47f-50f3-4305-b359-e65a56d984ad tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.299973 Jun 28 17:47:26.875016 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 53/109] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:26 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:26.914723 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:26.928468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e77f446a-bd27-464b-b799-3761a6b43db3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.592765 Jun 28 17:47:26.939104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 57/110] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:26 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:27.897377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:27.898470 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:27.936956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:27.940025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:27.958481 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:27.961781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:27.963809 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:27.965584 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:28.008535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=60 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:28.018543 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:28.020785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:28.021927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:28.022898 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:28.474879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:28.488815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3be42bd3-912d-46c0-a54c-92e1acca8b9a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1321 microversion: 2.1 time: 0.543631 Jun 28 17:47:28.490667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 58/111] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:27 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:28.497806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:28.499025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645dd1b4-7c12-4bd4-9db4-32f919596f8e"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:28.501184 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:28.512220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:28.512983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:28.514295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:28.514995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:28.519751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-29c01ad7-f3b8-4ce7-bb98-aa28892ad009 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1361 microversion: 2.1 time: 0.628497 Jun 28 17:47:28.522151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 54/112] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:27 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1361 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:29.523311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:29.527613 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:29.545907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:29.547203 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:29.549026 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:29.549925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:29.811353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:29.846537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8f6c9b4b-6433-43ae-9a8b-cd8d9ba200bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1516 microversion: 2.1 time: 0.329936 Jun 28 17:47:29.860438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 55/113] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:29 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:29.863125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:29.867190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:29.880712 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:29.881906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:29.883711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:29.884771 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.179580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:30.202776 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4758a9db-f4fd-4615-8043-f1edec8dd41c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1547 microversion: 2.1 time: 0.354129 Jun 28 17:47:30.205698 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 56/114] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:29 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1547 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:30.233188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:30.236345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:30.269152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.270003 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.271440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.272204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.407965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'flavor' on Instance uuid 427293a6-e0fd-4178-9bff-2277df234adb {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:47:30.678134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-81ef78af-4888-4edb-bf5f-4022d4c904c8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb/action" status: 200 len: 32 microversion: 2.1 time: 0.469799 Jun 28 17:47:30.685542 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 57/115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:47:30 2022] POST /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb/action => generated 32 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:47:30.692444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:30.697448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:30.712398 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.713707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.716801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.718549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.896550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e5c43f95-a9d9-47bc-97eb-1c6e4299cff6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214929 Jun 28 17:47:30.897736 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:47:30 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:30.914291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-58db33c8-09a5-47aa-a909-a1dcf38b3413 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "POST /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.414041 Jun 28 17:47:30.915269 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 59/117] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:47:28 2022] POST /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e/os-volume_attachments => generated 194 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:30.927067 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:30.930586 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:30.971522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.973427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:30.975463 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:30.976129 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:31.478975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:31.504106 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:31.512541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d4275dda-c5d6-4eff-af19-aa22ed3f0281 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.613078 Jun 28 17:47:31.514851 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 59/118] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:30 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:32.545797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:32.547143 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:32.559038 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:32.559852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:32.561291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:32.562002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:32.827750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:32.846622 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c086bcd7-7125-4819-9e05-40684e294075 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.309637 Jun 28 17:47:32.847642 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 60/119] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:32 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:33.432580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-89de9f1a-0351-49f8-82da-0f4aef62afb2 req-3e4cd4c4-428a-4efe-a45d-75b7d58293a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc", "tag": "553daf34-1a16-4c07-b5ee-f59783300d84"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:33.464197 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=64 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:33.474006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-89de9f1a-0351-49f8-82da-0f4aef62afb2 req-3e4cd4c4-428a-4efe-a45d-75b7d58293a6 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:33.475488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-89de9f1a-0351-49f8-82da-0f4aef62afb2 req-3e4cd4c4-428a-4efe-a45d-75b7d58293a6 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:33.518087 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-89de9f1a-0351-49f8-82da-0f4aef62afb2 req-3e4cd4c4-428a-4efe-a45d-75b7d58293a6 service nova] Creating event network-changed:553daf34-1a16-4c07-b5ee-f59783300d84 for instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc on hv-cinder-84801 Jun 28 17:47:33.530946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-89de9f1a-0351-49f8-82da-0f4aef62afb2 req-3e4cd4c4-428a-4efe-a45d-75b7d58293a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102172 Jun 28 17:47:33.533858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 60/120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:33.895969 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:33.898420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:33.933522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:33.934784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:33.936602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:33.938773 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:34.611299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:34.647558 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6eb196c5-2022-4c37-b775-a1079584a21e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.784975 Jun 28 17:47:34.664984 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:33 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:35.683968 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:35.684726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:35.692095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:35.692576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:35.693367 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:35.693798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:35.918671 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:35.932184 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-48f15e13-0c75-41ed-9d1c-34304f58d968 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.258261 Jun 28 17:47:35.933160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 61/122] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:35 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:36.959905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:36.960958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:36.984090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:36.984796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:36.986054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:36.986940 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:37.443857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:37.456813 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-88347eb9-d1b5-41b3-9e4d-89c5134b3551 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.502965 Jun 28 17:47:37.460629 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 62/123] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:36 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:38.486241 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:38.487566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:38.494941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:38.495562 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:38.496216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:38.496918 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:38.826815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:38.841559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-809ab56a-92c9-45f2-9994-895abf031e66 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.359625 Jun 28 17:47:38.855873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:38 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:39.876258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:39.878612 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:39.923888 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:39.927537 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:39.933199 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:39.939651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:40.348516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:40.394431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-334efa9f-cfdb-4afa-bbc9-214e88be5fbb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.531930 Jun 28 17:47:40.399401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:39 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:40.862241 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:40.863143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:40.875457 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:40.876118 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:40.877538 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:40.878270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:40.916221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:47:41.098010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-88cfd28a-c639-4473-819a-25fd4c2dec3c tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 204 len: 0 microversion: 2.1 time: 0.244612 Jun 28 17:47:41.099120 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:47:40 2022] DELETE /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:47:41.113527 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:41.114595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:41.130737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:41.131881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:41.133719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:41.134717 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:41.425396 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:41.427620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:41.438998 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:41.440757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:41.443700 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:41.444895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:41.455040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:41.470353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-595eaacb-f21a-4772-8daa-4a76b8486a97 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1554 microversion: 2.1 time: 0.364605 Jun 28 17:47:41.471331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 64/127] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:41 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1554 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:41.875560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:41.895486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-31c32afd-f619-4caa-8d3b-47c962d2db3d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.477328 Jun 28 17:47:41.897649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 64/128] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:41 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:42.500031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:42.504769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:42.529905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:42.531079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:42.533253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:42.534059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:42.913103 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:42.921260 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:42.922765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:42.929408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:42.930068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:42.930870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:42.931306 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:42.936618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8135a77e-dc42-4e63-aa5e-5e5a7677a65e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1554 microversion: 2.1 time: 0.443733 Jun 28 17:47:42.941155 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 65/129] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:42 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1554 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:43.279794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:43.297640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-37790a43-5a26-43af-9996-6b58c30b0738 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.379950 Jun 28 17:47:43.308049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 65/130] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:42 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:43.958680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:43.959287 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:43.966255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:43.966707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:43.967523 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:43.968008 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:44.173257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:44.183361 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bc3a812f-b579-4c75-bfac-0daac5e1e38d tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1554 microversion: 2.1 time: 0.228569 Jun 28 17:47:44.188436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 66/131] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:43 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:44.330028 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:44.331115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:44.337230 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:44.337973 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:44.338743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:44.339471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:44.538766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:44.553041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-dde96569-fdf2-4ad9-9c50-75a3684387fe tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.226871 Jun 28 17:47:44.563237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 66/132] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:44 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:45.201413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:45.202133 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:45.213112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:45.213895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:45.215112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:45.215644 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:45.497650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:45.507599 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c3c04244-ddef-49d7-8c73-7a4a43245d6f tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1554 microversion: 2.1 time: 0.310393 Jun 28 17:47:45.508234 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 67/133] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:45 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:45.573126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:45.573987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:45.582061 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:45.582851 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:45.583660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:45.584334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:45.870099 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:45.889930 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5a025404-be74-4807-9851-d81d18972aee tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.320157 Jun 28 17:47:45.892492 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 67/134] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:45 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:46.548626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:46.552340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:46.568278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:46.569032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:46.570230 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:46.570794 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:46.915432 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:46.916334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:46.928132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:46.928787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:46.929816 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:46.930410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:47.056730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:47.063669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:47.109963 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e31bed5a-4849-41bc-8fda-3766a493f3ae tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1554 microversion: 2.1 time: 0.584281 Jun 28 17:47:47.124655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 68/135] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:46 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1554 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:47.224864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:47.243348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d1f0e7d5-0c32-4b17-b330-21e0e5bba7c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.336239 Jun 28 17:47:47.244045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:46 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:48.146669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:48.147842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:48.163327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:48.163907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:48.165211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:48.166144 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:48.261475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:48.262154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:48.277600 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:48.278052 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:48.279107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:48.279702 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:48.345178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:48.361691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-171b5b55-2abe-41f3-8fe9-e44fd8b2ac3e tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1512 microversion: 2.1 time: 0.223556 Jun 28 17:47:48.363041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 69/137] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:48 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:48.368902 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-431c9ed0-e918-48a4-8993-52b4c124eb7b req-cd3f6b64-885f-4442-92fb-9754769e4cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e", "name": "network-vif-deleted", "tag": "993cf18a-c58f-496d-b680-d71128ef3f26"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:47:48.382064 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-431c9ed0-e918-48a4-8993-52b4c124eb7b req-cd3f6b64-885f-4442-92fb-9754769e4cfc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:48.382748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-431c9ed0-e918-48a4-8993-52b4c124eb7b req-cd3f6b64-885f-4442-92fb-9754769e4cfc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:48.407141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-431c9ed0-e918-48a4-8993-52b4c124eb7b req-cd3f6b64-885f-4442-92fb-9754769e4cfc service nova] Creating event network-vif-deleted:993cf18a-c58f-496d-b680-d71128ef3f26 for instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e on hv-cinder-84801 Jun 28 17:47:48.416669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-431c9ed0-e918-48a4-8993-52b4c124eb7b req-cd3f6b64-885f-4442-92fb-9754769e4cfc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Jun 28 17:47:48.417855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 70/138] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:47:48.499945 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:48.510293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a1186e3d-ee9b-41a8-a9da-7a1123fdb760 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.252585 Jun 28 17:47:48.511757 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:48 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:49.402772 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:49.404758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:49.413903 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:49.414878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:49.416014 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:49.416836 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:49.510838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:49.520894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9b1a911a-11b3-400b-b59a-f6a45e363093 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1346 microversion: 2.1 time: 0.134946 Jun 28 17:47:49.521539 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 71/140] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:49 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:49.539085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:49.540749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:49.548213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:49.548713 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:49.549516 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:49.549983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:49.727139 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:49.736753 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c0f8f117-4230-491e-b8fc-1f67a1d37fab tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.202026 Jun 28 17:47:49.747646 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 70/141] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:49 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:50.553701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:50.559485 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:50.586335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:50.587202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:50.588785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:50.589627 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:50.738293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:50.760832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:50.764041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:50.766597 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b519972d-2229-4afd-a9df-45001ac07bb9 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1346 microversion: 2.1 time: 0.220318 Jun 28 17:47:50.784756 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:50.786762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:50.788626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:50.789749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:50.795953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 72/142] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:50 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:50.971733 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:50.979936 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3c1ad14a-a4c1-41a1-9dbd-07cd4e8864b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.227391 Jun 28 17:47:50.980999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:50 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:51.802145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:51.803117 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:51.810659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:51.811120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:51.811913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:51.812593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:51.910623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:51.928651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5e79a8cc-cfc6-4770-89ec-d2ddacdacb81 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1346 microversion: 2.1 time: 0.132683 Jun 28 17:47:51.941680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 73/144] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:51 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:47:52.010107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:52.011113 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:52.021842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:52.022717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:52.024626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:52.025320 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:52.262041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:52.278797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c4a613c3-4a64-4d58-a0b3-6de9d732dce6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.275531 Jun 28 17:47:52.280188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 72/145] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:52 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:52.948933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:52.949611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:52.959089 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:52.959763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:52.960305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:52.960971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:53.308514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:53.312176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:53.314436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:53.327655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cb9d7687-b171-4bd4-b693-e3892251dbc7 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1346 microversion: 2.1 time: 0.381610 Jun 28 17:47:53.328296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:53.329079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:53.331368 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:53.332800 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:53.339337 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 74/146] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:52 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1346 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:53.649597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:53.668138 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3b13e287-4695-411e-b9ec-6981517e5e04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.364114 Jun 28 17:47:53.669474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 73/147] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:53 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:54.372160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:54.373338 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:54.387696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:54.390568 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:54.392849 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:54.394512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:54.461211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:54.461995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:54.462654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lazy-loading 'fault' on Instance uuid d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:47:54.544750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed055062d3e7415bbc409e5bb8109cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c59df85f40d4146ae0b7180ca9034d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:54.556006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fdc61170-bd19-457a-94ba-dc7de1e58879 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 200 len: 1351 microversion: 2.1 time: 0.207004 Jun 28 17:47:54.557021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 75/148] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:54 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:54.691610 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:54.692198 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:54.705716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:54.707223 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:54.709390 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:54.710419 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:55.577474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:55.578202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:55.579509 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:55.592162 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:55.592415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2f08b550-8206-4d51-aafd-4768b8b97bf0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.904807 Jun 28 17:47:55.592996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:55.594042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:55.594483 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:55.600837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 74/149] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:54 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:55.631923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] HTTP exception thrown: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Request method failure captured: Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e HTTP/1.1 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz58XOxICO1_LzNdUbwgLI_cZk_c6adjEHOgR0kZAi5KFijTorDmrkbHeNlmiQIOcv16V2h-MutZT7n0nnE5a8peV5TTWZvGjiZV28yNIYU34jOsaw-EOS9W0z0c99IexJ-BP0qtyLR4e385uE_Jf1DWDlHiBNDb4fghWjfDYGr1_mw Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:47:55.640030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}] Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: ed055062d3e7415bbc409e5bb8109cab Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.641891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'd19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e'} Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:47:55.642578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.643673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.644688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Returning 404 to user: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:47:55.644688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5fa605ec-b1b8-449a-bd98-eac396f81a19 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 404 len: 111 microversion: 2.1 time: 0.070136 Jun 28 17:47:55.645845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 76/150] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:55 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:47:55.889388 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:55.890377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:55.902990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:55.907839 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:55.909141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:55.912401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:55.936511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] HTTP exception thrown: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Request method failure captured: Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e/os-volume_attachments HTTP/1.1 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz58XOxICO1_LzNdUbwgLI_cZk_c6adjEHOgR0kZAi5KFijTorDmrkbHeNlmiQIOcv16V2h-MutZT7n0nnE5a8peV5TTWZvGjiZV28yNIYU34jOsaw-EOS9W0z0c99IexJ-BP0qtyLR4e385uE_Jf1DWDlHiBNDb4fghWjfDYGr1_mw Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:47:55.942409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}] Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: ed055062d3e7415bbc409e5bb8109cab Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.943626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'server_id': 'd19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e'} Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:47:55.944324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:55.945353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:55.949195 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Returning 404 to user: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:47:55.950300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-577ae7ab-8520-402d-9e84-170273bcfa32 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068352 Jun 28 17:47:55.968838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 75/151] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:47:55 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e/os-volume_attachments => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:47:56.625253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:56.626733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:56.643874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:56.644321 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:56.651303 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:56.652080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:56.962918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:57.006466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b78e6818-dffe-439c-9560-d8e0353b7901 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.397264 Jun 28 17:47:57.019138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:56 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:58.029502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:58.029502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:58.043114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:58.043550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:58.044421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:58.044795 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:58.068993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:58.356068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:58.379551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d567429b-33a3-4ed7-93f4-1e8260527b48 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.356388 Jun 28 17:47:58.385021 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 76/153] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:58 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:47:59.405518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:59.406220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:59.408801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=42 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:59.444828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.445744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.447137 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.448055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.516007 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:59.517435 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:59.535882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.536746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.538311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.538979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.607950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] HTTP exception thrown: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Request method failure captured: Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e HTTP/1.1 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz58XOxICO1_LzNdUbwgLI_cZk_c6adjEHOgR0kZAi5KFijTorDmrkbHeNlmiQIOcv16V2h-MutZT7n0nnE5a8peV5TTWZvGjiZV28yNIYU34jOsaw-EOS9W0z0c99IexJ-BP0qtyLR4e385uE_Jf1DWDlHiBNDb4fghWjfDYGr1_mw Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:47:59.610979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}] Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: ed055062d3e7415bbc409e5bb8109cab Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.612448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'd19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e'} Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:47:59.613664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.615490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.618092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Returning 404 to user: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:47:59.619939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cad40448-6049-4b14-9409-5ed24cfd85ee tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 404 len: 111 microversion: 2.1 time: 0.113708 Jun 28 17:47:59.621264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 77/154] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:47:59 2022] DELETE /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:47:59.650821 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:47:59.651764 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] [instance: d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:47:59.663193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.664117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.667404 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:47:59.668093 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:47:59.696424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] HTTP exception thrown: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Request method failure captured: Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e HTTP/1.1 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz58XOxICO1_LzNdUbwgLI_cZk_c6adjEHOgR0kZAi5KFijTorDmrkbHeNlmiQIOcv16V2h-MutZT7n0nnE5a8peV5TTWZvGjiZV28yNIYU34jOsaw-EOS9W0z0c99IexJ-BP0qtyLR4e385uE_Jf1DWDlHiBNDb4fghWjfDYGr1_mw Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:47:59.698173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c59df85f40d4146ae0b7180ca9034d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c59df85f40d4146ae0b7180ca9034d7"}]}] Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 5c59df85f40d4146ae0b7180ca9034d7 Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-DeleteServersTestJSON-1400607136 Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: ed055062d3e7415bbc409e5bb8109cab Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-DeleteServersTestJSON-1400607136-project Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.700349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'd19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e'} Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:47:59.701280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. Jun 28 17:47:59.702478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:47:59.705347 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] Returning 404 to user: Instance d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:47:59.706686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cf2dc9bf-3dfc-47fd-8ea0-5fecdf23d8e3 tempest-DeleteServersTestJSON-1400607136 tempest-DeleteServersTestJSON-1400607136-project] 10.222.0.43 "GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e" status: 404 len: 111 microversion: 2.1 time: 0.072966 Jun 28 17:47:59.707773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 78/155] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:59 2022] GET /compute/v2.1/servers/d19ffd61-dd50-4f3a-b7e4-c9e0123cbb2e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:47:59.872665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:47:59.890223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-769734da-2db8-445b-a054-9b3fe225bddf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.492376 Jun 28 17:47:59.903762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 78/156] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:47:59 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:00.918290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:00.919553 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:00.932223 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:00.933800 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:00.935495 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:00.937900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:01.573989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:01.588523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2c4780a8-c6ed-4673-878c-a7945e292148 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.679819 Jun 28 17:48:01.588980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 79/157] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:00 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:02.643057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:02.644795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:02.660927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:02.667860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:02.677639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:02.679429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:03.143893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:03.160679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1255f54a-afcd-4f42-be5b-d028678a620c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.557326 Jun 28 17:48:03.161058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 79/158] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:02 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:04.178910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:04.179573 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:04.184245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:04.208138 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:04.208621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:04.211808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:04.212266 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:04.606363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:04.619935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b71e42fa-5738-49b0-9f1f-9ac310e44191 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.445901 Jun 28 17:48:04.629325 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 80/159] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:04 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:05.659595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:05.660930 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:05.726317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:05.728761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:05.737180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:05.739118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:06.615348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:06.662072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-52d81b56-3395-45d2-add4-01cb6dc5b0af tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 1.019011 Jun 28 17:48:06.678953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 80/160] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:05 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:07.695744 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:07.698751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:07.727008 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:07.728137 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:07.733580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:07.738895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:08.105875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:08.136801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cdfd59c0-0abc-41b1-8f26-970aa52646bd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.448411 Jun 28 17:48:08.141631 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 81/161] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:07 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:09.156582 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:09.158239 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:09.177782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:09.185039 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:09.193188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:09.196208 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:10.256344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:10.280511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b12d57f4-2592-42e8-9a90-c5bb1cc203c2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 1.128774 Jun 28 17:48:10.294121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 81/162] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:09 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:11.331481 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:11.333062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:11.340707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:11.341308 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:11.342321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:11.343068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:11.519068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:11.545422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7352a142-7eed-4d62-95ce-cad27b4d8ca8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.219782 Jun 28 17:48:11.547381 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 82/163] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:11 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:12.583867 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:12.585981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:12.651514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:12.652792 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:12.661165 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:12.666015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:13.018025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:13.050396 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9421e1fa-dad5-4eea-b254-939b3d4e5160 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.469741 Jun 28 17:48:13.071778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 82/164] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:12 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:14.078685 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:14.080072 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:14.096861 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:14.097833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:14.099222 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:14.099874 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:14.357059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:14.366322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-73351fd2-b074-4022-973e-b9d9d70b75cf tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.295971 Jun 28 17:48:14.379795 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 83/165] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:14 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:15.385637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:15.386967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:15.397035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:15.400601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:15.404219 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:15.404869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:15.903177 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:15.915797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cba3d5ce-6cb7-4e58-8e8e-481a157fef6c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.534108 Jun 28 17:48:15.921395 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 83/166] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:15 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:16.936089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:16.937234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:16.953255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:16.953379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:16.954201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:16.954721 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:17.319488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:17.333140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-df652d67-452a-4eb1-a023-496cd83d24b3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.401663 Jun 28 17:48:17.334625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 84/167] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:16 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:18.352915 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:18.353651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:18.380462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:18.390557 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:18.392311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:18.393188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:18.399298 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=85 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:18.837564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:18.854483 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1ef1c012-f18e-4cd5-9122-2ff7298bfe87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.506556 Jun 28 17:48:18.863605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 84/168] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:18 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:19.894986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:19.896660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:19.920504 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:19.921284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:19.935819 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:19.944642 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:20.256818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6ea7001-67ea-4850-b16a-ecd39c428e96 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'create', calling method: .version_select at 0x7f57722ec040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1762742589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwEtVAxYeuJnKUOlZlQoytFWKFM+hNIlMC0FPmrpyurYSQgz77zi2fnR6NLNlC8y0Ta7/uabtqMnyadHKYaZJM2RiZ6AZ/hNR5lAx+PAC45maSO1Lu+RFgKX5yKiNCZVg=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:20.299089 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-d6ea7001-67ea-4850-b16a-ecd39c428e96 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Getting quotas for project 63b5557298f24f0bb26ce631568ef4f4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:48:20.329353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-d6ea7001-67ea-4850-b16a-ecd39c428e96 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Getting quotas for user b34f604dcc0a4639884bb925cabfd535 and project 63b5557298f24f0bb26ce631568ef4f4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:48:20.380879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d6ea7001-67ea-4850-b16a-ecd39c428e96 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.127760 Jun 28 17:48:20.382148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 85/169] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:48:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:20.392287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:20.428813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0cff3527-df3b-4cda-9c7f-85ae85aed9f2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1522 microversion: 2.1 time: 0.540532 Jun 28 17:48:20.457186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 85/170] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:19 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:20.623676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2096065966", "imageRef": "0db73fb8-7794-41c3-bba6-b3377f0c6fc1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1762742589", "networks": [{"uuid": "4ba9b510-9db8-4360-a184-1b5ef317e5da"}]}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:20.783019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] validate_networks() for [('4ba9b510-9db8-4360-a184-1b5ef317e5da', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:48:21.464436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:21.466289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:21.477414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:21.478039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:21.479498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:21.480156 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:21.800920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:21.824045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-144d9cbe-8c40-4d09-aefd-409147acafb6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1502 microversion: 2.1 time: 0.361023 Jun 28 17:48:21.825554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 86/171] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:21 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:21.842434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:21.843059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:21.853980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:21.855451 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:21.856334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:21.858751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:22.103386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:22.115067 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-05ff8318-c7e1-48f4-862c-a73212d750bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1516 microversion: 2.1 time: 0.277471 Jun 28 17:48:22.126939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 87/172] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:21 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:22.160336 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:48:22.161111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:48:22.162021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:48:22.163104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:48:22.163859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:48:22.222822 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:22.226233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:22.236807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:22.239098 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:22.316968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Getting quotas for project 63b5557298f24f0bb26ce631568ef4f4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:48:22.333885 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Getting quotas for user b34f604dcc0a4639884bb925cabfd535 and project 63b5557298f24f0bb26ce631568ef4f4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:48:22.369343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:48:22.377279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0db73fb8-7794-41c3-bba6-b3377f0c6fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:48:22.506625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-30040fad-6c89-445b-8a96-26a613435bcf tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891090 Jun 28 17:48:22.507635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 86/173] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:48:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:48:22.523799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c1e058f5-27de-40cb-9067-da929d1167be tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:22.524524 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c1e058f5-27de-40cb-9067-da929d1167be tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:22.732321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c1e058f5-27de-40cb-9067-da929d1167be tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:22.757110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c1e058f5-27de-40cb-9067-da929d1167be tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1259 microversion: 2.1 time: 0.233482 Jun 28 17:48:22.771166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 88/174] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:22 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:23.779819 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:23.782846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:23.817784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:23.821062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:23.825154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:23.826291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:23.991779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:24.025117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-66d8bc21-7769-42d5-85b5-1b6e40aaf99a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1263 microversion: 2.1 time: 0.247478 Jun 28 17:48:24.026228 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 89/175] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:23 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:24.307625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8fa3270-f742-4b75-b43f-8ac226068f51 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: .version_select at 0x7f5772488af0>, body: {"keypair": {"name": "tempest-keypair-62440747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJchbezao4i+3zT62bBd6iz3aKD4EYGZLsUzRPKlat/MdPJk0n3OYvsM5DnLZRfBQxHxoVfywGyQifRn4vli065m4MVld3l1DiiqCtW5vqo4M07ZcWNbj5YucyLKd/UEw=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:24.338978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f8fa3270-f742-4b75-b43f-8ac226068f51 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for project 617c65d2596b4cce9db8ef1806b98460. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:48:24.346973 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f8fa3270-f742-4b75-b43f-8ac226068f51 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for user 2a63dee5a6194467a325c9499cd89bb0 and project 617c65d2596b4cce9db8ef1806b98460. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:48:24.399801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f8fa3270-f742-4b75-b43f-8ac226068f51 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.784788 Jun 28 17:48:24.401826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 87/176] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jun 28 17:48:23 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 788 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 28 17:48:25.052341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:25.054598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:25.092673 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:25.106359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:25.108138 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:25.115784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:25.289581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:25.303981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-07ed3bad-f04a-40b6-8313-8fcfa080dfb5 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1263 microversion: 2.1 time: 0.257109 Jun 28 17:48:25.305445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 90/177] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:25 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:26.336799 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:26.338079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:26.384917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.385685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:26.389063 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.414993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:26.420688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:26.422386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:26.434600 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.439242 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:26.441264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.442368 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:26.547687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'flavor' on Instance uuid cdf62a85-c4fd-4de1-8b36-5868f2a1fede {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:48:26.765662 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:26.797627 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-182c3fdf-1b1d-4a6e-b546-88d428141175 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1255 microversion: 2.1 time: 0.469779 Jun 28 17:48:26.802162 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 88/178] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:26 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1255 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:26.869881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-97badb10-c357-46a2-baa6-190722279d28 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/action" status: 200 len: 32 microversion: 2.1 time: 0.454294 Jun 28 17:48:26.871180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 91/179] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:48:26 2022] POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:48:26.885235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:26.886471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:26.923152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.929408 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:26.941883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:26.942770 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:27.834149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:27.837740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:27.872681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:27.874797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:27.876211 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:27.891772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:28.284663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:28.310305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:28.326136 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2acf64b7-6797-4c2f-bdd5-d9a89626be8f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1317 microversion: 2.1 time: 0.504685 Jun 28 17:48:28.333106 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 92/180] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:27 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:28.572842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:28.613164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0971a5b4-7535-4ac7-8a33-e8f3060bd7e8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 1.733884 Jun 28 17:48:28.614194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 89/181] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:26 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:29.361698 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:29.364557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:29.399169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:29.400146 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:29.401609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:29.402342 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:29.587885 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:29.599141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f70c3d07-d8bc-4e65-8b79-764d6ef0814c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1317 microversion: 2.1 time: 0.243792 Jun 28 17:48:29.601984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 93/182] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:29 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:29.652453 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:29.655566 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:29.674298 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=5 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:29.679666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:29.682251 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:29.685333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:29.687065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:30.350797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:30.396073 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4e2d4cad-811c-4aa4-b78d-349250b36b9e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.767654 Jun 28 17:48:30.396741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 90/183] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:29 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:30.626888 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:30.627979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:30.686759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:30.692083 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:30.700923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:30.702609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:31.320070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-5822350", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f3a3ed5-dd16-44db-94f8-523fb0ae05d5"}], "security_groups": [{"name": "tempest-securitygroup--1457386537"}], "key_name": "tempest-keypair-62440747", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:31.616502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:31.634437 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1eb9d83b-e2d9-4047-8328-bd093425412c tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 1.012863 Jun 28 17:48:31.639465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 94/184] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:30 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:31.656421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:31.661743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:31.707203 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:31.711963 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:31.713753 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:31.717785 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:31.989602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] validate_networks() for [('8f3a3ed5-dd16-44db-94f8-523fb0ae05d5', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:48:32.167803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:32.188400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5038c795-af28-4c4b-8204-79777c3a1280 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.542533 Jun 28 17:48:32.190238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 95/185] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:31 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:32.283320 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:32.659443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:32.660585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:32.700365 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:32.704484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:32.704484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:32.704484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:32.742273 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:33.362383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:48:33.363165 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:48:33.364157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:48:33.364992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:48:33.366529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:48:33.414119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:33.415654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:33.417778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:33.421217 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:33.522571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for project 617c65d2596b4cce9db8ef1806b98460. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:48:33.552422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for user 2a63dee5a6194467a325c9499cd89bb0 and project 617c65d2596b4cce9db8ef1806b98460. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:48:33.606319 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:48:33.612575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:33.621467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:48:33.651804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b396b015-aa55-4caa-a90e-85af4d2dfbc1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.999579 Jun 28 17:48:33.668428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 96/186] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:32 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:33.676488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:33.679664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:33.706076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:33.708534 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:33.711351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:33.712196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:33.727426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-be5aafcf-9108-489b-9919-4155c58e4729 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.409681 Jun 28 17:48:33.736857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 91/187] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Jun 28 17:48:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 17:48:33.753741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:33.754737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:33.912625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:33.928478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:33.944526 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:33.949918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-72016f68-f4d4-41d0-a7d3-4e6835d05a48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1277 microversion: 2.20 time: 0.200877 Jun 28 17:48:33.971739 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 92/188] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:33 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:34.590648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:34.607392 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a19d7eb6-9f02-4158-a2dd-f1ceba591883 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.949544 Jun 28 17:48:34.633030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 97/189] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:33 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:34.691889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:34.693234 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:34.742962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:34.750712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:34.753720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:34.759430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:34.979944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:34.981626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:34.984147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=38 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:35.102725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:35.119447 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:35.127127 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:35.131073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d01f720c-7b12-48e8-a2d1-70de02a36afe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1277 microversion: 2.20 time: 0.155359 Jun 28 17:48:35.132645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 98/190] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:34 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:35.239126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-384b9ac6-fe9d-43cc-a87c-1ba8c4901305 req-2031cc2b-4117-4ace-b329-bdc95697e2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:35.252603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-384b9ac6-fe9d-43cc-a87c-1ba8c4901305 req-2031cc2b-4117-4ace-b329-bdc95697e2c3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:35.253273 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-384b9ac6-fe9d-43cc-a87c-1ba8c4901305 req-2031cc2b-4117-4ace-b329-bdc95697e2c3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:35.327419 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-384b9ac6-fe9d-43cc-a87c-1ba8c4901305 req-2031cc2b-4117-4ace-b329-bdc95697e2c3 service nova] Creating event network-changed:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:48:35.335064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-384b9ac6-fe9d-43cc-a87c-1ba8c4901305 req-2031cc2b-4117-4ace-b329-bdc95697e2c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099434 Jun 28 17:48:35.336321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 99/191] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:35.354160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:35.368232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-55503069-a584-4fdc-879a-863c58f5a35a tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.684406 Jun 28 17:48:35.374945 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 93/192] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:34 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:35.639379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:35.640652 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:35.649361 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:35.649801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:35.650912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:35.651534 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:35.912620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:35.939862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-91bdcdda-3280-4b0a-8174-f7efbbd771c4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.303564 Jun 28 17:48:35.953440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 100/193] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:35 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:36.152961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:36.153866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:36.165861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.165861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.178142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.178598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.281382 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:36.292275 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:36.295356 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:36.296058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d33ec40a-6d10-47ce-a9b5-135e758275be tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1281 microversion: 2.20 time: 0.149310 Jun 28 17:48:36.296775 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 94/194] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:36 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1281 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:48:36.396279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:36.398230 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:36.409845 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.410589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.411958 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.412965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.758944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:36.779730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-095e63d2-53e5-4cb5-8a77-ab9511031dfe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.389928 Jun 28 17:48:36.781522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 101/195] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:36 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:36.842986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:36.846455 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:36.879868 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.881261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.883824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:36.885139 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:36.953920 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6c4642af-3091-42b8-99ab-07710f5d0ce1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/ips" status: 200 len: 145 microversion: 2.1 time: 0.146781 Jun 28 17:48:36.955051 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 95/196] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:48:36 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/ips => generated 145 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:36.976178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:36.978463 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:37.007338 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.012510 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:37.018329 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.021749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:37.316236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:37.321227 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:37.348581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.349036 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:37.349863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.350306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:37.486444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:37.497326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:37.530149 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:37.532769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c8dedd1b-858c-4eb1-b7d8-c96686d04f27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.560611 Jun 28 17:48:37.541071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 102/197] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:36 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:37.543061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:37.544692 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3bba0184-8698-4e79-af3a-41a269c338bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1281 microversion: 2.20 time: 0.233066 Jun 28 17:48:37.550096 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 96/198] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:37 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:37.815965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:37.819020 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:37.834948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.836460 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:37.841130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:37.841951 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:38.587796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:38.594727 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:38.649735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:38.657791 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:38.665312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:38.669574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:39.064643 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:39.128201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bcb265f0-72c5-4295-b914-02cdbffb8b01 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 1.311700 Jun 28 17:48:39.129839 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 103/199] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:37 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:39.167164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:39.183466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:39.214838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:39.230959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:39.235801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:39.248443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:39.273502 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:39.285711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1306ec17-d4f3-469f-b373-650b81d36f07 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.705293 Jun 28 17:48:39.286784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 97/200] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:38 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:39.685686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:39.697498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:39.715472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:39.717050 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-67b7efb6-e230-4da4-ad9d-69bf4d6ea2aa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1337 microversion: 2.20 time: 0.585572 Jun 28 17:48:39.718363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 104/201] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:39 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1337 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:40.152854 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:40.153726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:40.167389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.168123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.171904 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.173981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.334074 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:40.335409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:40.344955 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.345410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.346330 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.346770 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.446143 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:40.481446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e59265ba-ef09-4fad-9b57-b0cf528bb120 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.336912 Jun 28 17:48:40.483476 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 98/202] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:40 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:40.556933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:40.565794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-320268c8-1099-4c63-9e92-01a0b7a737a5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.251555 Jun 28 17:48:40.566393 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 105/203] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:40 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:40.741148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:40.742429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:40.754004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.754880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.756413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:40.757293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:40.860338 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:40.869509 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:40.871066 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:40.872252 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6c95392b-debe-4bff-aa8d-d95abecad643 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.138959 Jun 28 17:48:40.872872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 99/204] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:40 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:41.502749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:41.503776 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:41.514171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.514983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.516577 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.517315 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.587069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:41.588808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:41.599190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.600176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.601361 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.603620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.730410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:41.744348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f2791acc-c04e-4a26-a049-5441d64eee69 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.248113 Jun 28 17:48:41.745590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 106/205] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:41 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:41.768782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:41.777524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3597f564-9dcf-4bc4-af9c-ac27ab43d84e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.195707 Jun 28 17:48:41.778216 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 100/206] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:41 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:41.892835 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:41.893371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:41.900919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.901362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.902116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:41.902573 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:41.979094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:41.991086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:41.991086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:41.993356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0a028492-41d2-4326-a00e-876ca14b4eb0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.105016 Jun 28 17:48:41.993952 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 107/207] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:41 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:42.765835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:42.766463 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:42.774260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:42.774733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:42.775517 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:42.775946 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:42.799678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:42.801965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:42.815494 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:42.816401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:42.817823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:42.818588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:43.079788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:43.103203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-37e07f30-9954-4078-b36b-06010fc18e06 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.341725 Jun 28 17:48:43.119181 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 101/208] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:42 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:43.126759 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:43.134235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:43.140265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:43.158070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:43.159092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8b4bea39-ca4b-4598-930c-3f9a6b79f462 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.365658 Jun 28 17:48:43.160176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:43.161057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:43.161488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 108/209] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:42 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:43.165278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:43.310038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75a5013a-986a-4c3f-a192-933de161200e"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:43.313422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:43.322098 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:43.332766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:43.336417 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:43.338634 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:43.340259 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:43.349705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:43.352007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:43.359652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a4ca3476-ebb6-4210-9f9a-f4a1bcd61d78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.238870 Jun 28 17:48:43.360251 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 102/210] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:43 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:44.037135 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2075477818", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "networks": [{"uuid": "a752b788-d73b-4672-b906-95074ebc616f"}]}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:44.049314 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:44.051371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=22 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:44.126171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] validate_networks() for [('a752b788-d73b-4672-b906-95074ebc616f', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:48:44.744934 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:48:44.745816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:48:44.746667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:48:44.747419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:48:44.748308 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:48:44.763922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:44.765092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:44.766461 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:44.767821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:44.808675 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Getting quotas for project 44f4fc9467814b1a8f25d88cd032d9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:48:44.814958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Getting quotas for user 9a78e8e67c904e7292923e4f0d06f1b6 and project 44f4fc9467814b1a8f25d88cd032d9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:48:44.832686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:48:44.835044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:48:44.895964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dab12d37-c47d-4776-8c09-b45572556e4d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864091 Jun 28 17:48:44.896959 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 103/211] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:48:44.902891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:44.903812 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:44.912471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:44.912934 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:44.913748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:44.914209 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.109615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:45.189666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.204249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1cb56073-b302-46cc-9840-901cf30c33a1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.305256 Jun 28 17:48:45.205355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 104/212] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:44 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:45.214025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:45.215090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:45.227626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.228843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.230377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.231487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.481407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.495146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d41ee2ad-dd16-486b-a7f9-572d88427415 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.288063 Jun 28 17:48:45.496755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 105/213] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:45 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:45.506028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:45.507982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:45.519117 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.519891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.520991 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.521511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.528455 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:45.607109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.624305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.628876 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.632323 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c707816f-7d47-45d1-9d98-4793a48f8ac5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.133315 Jun 28 17:48:45.633711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 106/214] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:45 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:45.642883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:45.644871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:45.657212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.658441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.660573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:45.661937 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:45.863270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:45.879211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6eaecd93-9de9-48d7-b1ff-626354b9d4db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1218 microversion: 2.1 time: 0.243468 Jun 28 17:48:45.880965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 107/215] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:45 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:46.231971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:46.234504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:46.247070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.247923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:46.249572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.250572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:46.511595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:46.522915 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9afd1f50-dc5b-407f-98be-fcc457a84248 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.297837 Jun 28 17:48:46.523774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 108/216] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:46 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:46.530398 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:46.531223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:46.540238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.540868 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:46.541793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.542756 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:46.878150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:46.896919 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-784afd30-d1ea-4d46-8a0c-0c8c7c15c8db tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.371517 Jun 28 17:48:46.898335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 109/217] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:46 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:46.922369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:46.923489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:46.935349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.936176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:46.937976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:46.938836 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.151731 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:47.181902 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:47.187009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:47.189076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b1590321-3104-4999-a133-c1324beb47c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.274656 Jun 28 17:48:47.190526 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 110/218] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:46 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:47.195531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:47.196088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:47.203956 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.204447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.205232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.205771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.374097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:47.402740 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-20ff0702-8117-4797-89e4-a3d60559455a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1218 microversion: 2.1 time: 0.210524 Jun 28 17:48:47.411838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 111/219] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:47 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:47.548665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:47.549676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:47.557775 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.558347 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.559571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.560312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.870625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:47.886319 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8782a877-04b4-4d56-9116-dd2404f16bbe tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.345031 Jun 28 17:48:47.887700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 112/220] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:47 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:47.928635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:47.930807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:47.944403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.945575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:47.947357 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:47.948517 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.266842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:48.276186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3dafd0c1-b6ee-4788-b4af-ad3ea3a8a76e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.355703 Jun 28 17:48:48.277806 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 113/221] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:47 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:48.300656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:48.306459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:48.332821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.334432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.336594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.337932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.465113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:48.474458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:48.476371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:48.477789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-49921b7b-8c43-47ce-bf23-838bcbf17714 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.198623 Jun 28 17:48:48.478676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 114/222] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:48 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:48.492860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:48.492860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:48.500146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.500646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.501436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.501861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.594622 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:48.610163 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-01e44ac2-b8ac-4b43-ae64-30b69d017321 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1218 microversion: 2.1 time: 0.130166 Jun 28 17:48:48.610762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 115/223] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:48 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:48.918686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:48.919595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:48.933620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.934067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:48.934870 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:48.935310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.196737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:49.222693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ba5487fd-130a-4408-97d8-76a3de46b782 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.923725 Jun 28 17:48:49.226502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 109/224] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:48:43 2022] POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments => generated 194 bytes in 5927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:49.307781 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:49.310168 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:49.334601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.338632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.340085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.342674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.485425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.506123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-74dd8b04-7621-4521-bbb5-071d4d0935dd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.590943 Jun 28 17:48:49.521859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 116/225] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:48 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:49.534685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:49.536325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:49.546591 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.547359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.548494 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.549542 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.581183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.593732 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6b7148bc-64b9-4580-84c5-ab46c5733a87 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.300868 Jun 28 17:48:49.594793 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 110/226] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:49 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:49.635344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:49.636267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:49.649699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.650425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.651605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:49.652232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:49.729742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.744569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.749622 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.755215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e0e8c11f-290d-4103-a61e-10c7fa826edd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1335 microversion: 2.20 time: 0.227166 Jun 28 17:48:49.756206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 117/227] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:49 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:49.905063 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:49.922849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6ff36921-0657-492f-aa6a-a779c2f495bc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1266 microversion: 2.1 time: 0.298128 Jun 28 17:48:49.929609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 111/228] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:49 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:50.536188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:50.537120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:50.544741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.545175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.546107 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.546550 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.627231 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:50.628237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:50.650746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.651892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.653467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.654449 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.794096 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:50.809772 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-426f242d-06e7-4747-a76c-bcaa2fa199f6 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.278884 Jun 28 17:48:50.810626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 118/229] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:50 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:50.815964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:50.816919 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:50.826137 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.826647 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.827631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.828094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.936963 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:50.950101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9c13384c-0d6a-43a0-bf74-fcb18b58cebc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.329056 Jun 28 17:48:50.951241 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 112/230] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:50 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:50.964344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:50.965451 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:50.972634 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.973151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:50.974446 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:50.974887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:51.074620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:51.083456 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:51.094066 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a5727e81-0831-47ac-8a78-c63b7a162955 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1272 microversion: 2.1 time: 0.138999 Jun 28 17:48:51.095288 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 113/231] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:50 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:51.095733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:51.099064 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:51.101165 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0df4bf5d-fc58-4ff9-be8a-5fa8535a36a7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.289006 Jun 28 17:48:51.102347 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 119/232] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:50 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:51.836644 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:51.837424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:51.845448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:51.846318 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:51.847454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:51.848081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:51.977171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:51.978305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:52.003407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.004236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.005762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.006556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.274650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.301549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fc127eb8-cad6-4a5d-b42c-6582dddce229 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.469036 Jun 28 17:48:52.306322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 114/233] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:51 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:52.320239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:52.322031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:52.331763 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.332657 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.333732 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.334543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.452360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.457932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.472591 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b03a5f18-bc80-45e4-826d-9e53ac2c93f3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1272 microversion: 2.1 time: 0.162139 Jun 28 17:48:52.473294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9e5ff042-c38b-4a95-b640-ee9c5d27c92b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.509419 Jun 28 17:48:52.474541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 115/235] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:52 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:52.484188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 120/235] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:51 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:52.489582 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-da0e9f19-3b01-406f-bbdc-5f1e4efd24a0 req-b7b35461-5c1b-4e06-a081-d2cde5413c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:52.495982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:52.497380 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:52.518940 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.519752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.521070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.521773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.522282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-da0e9f19-3b01-406f-bbdc-5f1e4efd24a0 req-b7b35461-5c1b-4e06-a081-d2cde5413c53 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:52.523680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-da0e9f19-3b01-406f-bbdc-5f1e4efd24a0 req-b7b35461-5c1b-4e06-a081-d2cde5413c53 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:52.549769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-da0e9f19-3b01-406f-bbdc-5f1e4efd24a0 req-b7b35461-5c1b-4e06-a081-d2cde5413c53 service nova] Creating event network-changed:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:48:52.563669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-da0e9f19-3b01-406f-bbdc-5f1e4efd24a0 req-b7b35461-5c1b-4e06-a081-d2cde5413c53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077706 Jun 28 17:48:52.564158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 121/236] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:52.867346 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.891745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.895116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:52.898370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8c26b557-b24a-4976-a233-3a3fa58b9431 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.410230 Jun 28 17:48:52.899673 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 116/237] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:52 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:53.346334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:53.347996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:53.368458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.380997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.382414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.383203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.492323 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:53.496890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:53.507440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.507900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.509108 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.509556 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.637597 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:53.652228 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6f6b037c-7335-4865-926f-27f7876d56d4 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.321150 Jun 28 17:48:53.654281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 122/238] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:53 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:53.663601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:53.664877 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:53.676853 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.677800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.679339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.680498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.710358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:53.838100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:53.866620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0a58dd4f-94ca-44dc-8131-d309e0dbdc2d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.377497 Jun 28 17:48:53.878039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 117/239] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:53 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:53.939215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:53.942248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:53.943103 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:53.954022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.955113 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.956932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:53.957095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-186d6793-551f-4583-b4ad-0cbd8c629bb1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.300282 Jun 28 17:48:53.957809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:53.966694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 123/240] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:53 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:54.307998 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:54.317933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:54.319766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:54.321168 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6035751b-51dd-4ba3-95ec-658e88b743a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.386818 Jun 28 17:48:54.321842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 118/241] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:53 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:54.486395 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-977f34d8-d4fa-4806-b5e3-5aabb3ff9306 req-07b15a62-ce62-42dd-bf42-32c6af887c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421913d2-e921-4384-9bdc-50d28ad4760f", "tag": "c2aebc18-4fd3-4bd9-a791-18e9f4656b2d"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:54.493128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:54.506333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-977f34d8-d4fa-4806-b5e3-5aabb3ff9306 req-07b15a62-ce62-42dd-bf42-32c6af887c9d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:54.507424 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-977f34d8-d4fa-4806-b5e3-5aabb3ff9306 req-07b15a62-ce62-42dd-bf42-32c6af887c9d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:54.529497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-977f34d8-d4fa-4806-b5e3-5aabb3ff9306 req-07b15a62-ce62-42dd-bf42-32c6af887c9d service nova] Creating event network-changed:c2aebc18-4fd3-4bd9-a791-18e9f4656b2d for instance 421913d2-e921-4384-9bdc-50d28ad4760f on hv-cinder-84801 Jun 28 17:48:54.538993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-977f34d8-d4fa-4806-b5e3-5aabb3ff9306 req-07b15a62-ce62-42dd-bf42-32c6af887c9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061077 Jun 28 17:48:54.539965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 124/242] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:54.673346 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:54.674339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:54.694339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:54.695192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:54.696607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:54.697307 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:54.903577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:54.906335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:54.932527 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:54.934237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:54.939833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:54.943295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:54.944518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:54.946456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:54.947471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:54.955880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9a10a518-680d-46c5-8aef-671dce3147d0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.284136 Jun 28 17:48:54.960598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 119/243] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:54 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:54.984114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:54.989876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:55.021740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.023362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.025081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.029458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.279406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:55.302283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e168d0a3-3e98-4852-89f2-8db4acb3059d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.321359 Jun 28 17:48:55.303196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 120/244] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:54 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:55.309667 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-ba31af70-db5c-477d-9411-3d1ca15786b5 req-6fc3511e-c59e-418e-b1e5-509f5021ecdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "name": "network-vif-plugged", "status": "completed", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:55.329710 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ba31af70-db5c-477d-9411-3d1ca15786b5 req-6fc3511e-c59e-418e-b1e5-509f5021ecdd service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.330627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ba31af70-db5c-477d-9411-3d1ca15786b5 req-6fc3511e-c59e-418e-b1e5-509f5021ecdd service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.353291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-ba31af70-db5c-477d-9411-3d1ca15786b5 req-6fc3511e-c59e-418e-b1e5-509f5021ecdd service nova] Creating event network-vif-plugged:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:48:55.361693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-ba31af70-db5c-477d-9411-3d1ca15786b5 req-6fc3511e-c59e-418e-b1e5-509f5021ecdd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056092 Jun 28 17:48:55.363264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 121/245] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:55.366461 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:55.369217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:55.370265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:55.385823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-39d0ff65-6cb0-4291-9aca-c3573809c847 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.490291 Jun 28 17:48:55.386860 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.387321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.388142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.396433 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.408567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 125/246] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:54 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:55.786882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:55.802637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:55.808857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:55.811075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-853e431d-2ea9-4f2d-8d21-c8ddb82bd205 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.446085 Jun 28 17:48:55.812668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 122/247] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:55 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:55.982495 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:55.983832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:55.994205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.995116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:55.996736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:55.997816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.331907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:56.334539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:56.350265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.351466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.353308 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.354689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.354808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:56.365406 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-37fb0714-1d1e-4983-95cd-2abd7a48fcc9 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.393254 Jun 28 17:48:56.366916 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 126/248] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:55 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:56.415380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:56.415887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:56.423375 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.424020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.425111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.425634 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.603103 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:56.612797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-52651b52-18aa-4c95-b3b8-9e514b6d84a1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.201146 Jun 28 17:48:56.622838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 127/249] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:56 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:56.728004 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:56.739675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0e3b930b-3318-4fa2-9b68-e11c47acffe1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.415556 Jun 28 17:48:56.740714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 123/250] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:56 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:56.837937 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:56.839312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:56.849467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.850249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:56.852094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:56.852917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.219633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:57.237913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:57.240512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:57.242447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2f010de4-0ba4-41bf-a574-5952b30aa763 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.412812 Jun 28 17:48:57.243764 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 128/251] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:56 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:57.394681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:57.396012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:57.409918 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.411029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.412778 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.413530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.597749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:57.606742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7bfae71b-3116-4887-a61d-999e01dc8381 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.219542 Jun 28 17:48:57.607453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 124/252] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:57 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:57.637258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:57.639019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:57.655828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.657398 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.659159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.660273 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.768461 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:57.770159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:57.782258 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.783493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.785297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.786417 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.943824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:57.959288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-23e62f24-36b5-47d0-8e3d-2cbea98c5591 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1502 microversion: 2.1 time: 0.330997 Jun 28 17:48:57.960322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 129/253] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:57 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:57.980610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02f7bbd-a422-4505-b96c-4f2b0b29fd56"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:57.982177 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:57.991094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.991798 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:57.993650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:57.994248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.032951 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] HTTP exception thrown: Cannot 'attach_volume' instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede while it is in vm_state rescued Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Request method failure captured: Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/os-volume_attachments HTTP/1.1 Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 74 Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz52F2ohNuDNMxC-uWBoBNH0ysWcOkUbK87Smi1Ju0PVZ89hIdmVzvxoR4ErOTZmyHDjxZPh9A-tuTD4va1BKFjgXj_s8g-nehsNT6wQ7AbWodU1ytU301QTtbY5OB3VYDIDNAeEz6kXgsg65NE6JikkC1jrTPo_W2zOY-2eozFkihg Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:48:58.041190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}] Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 3a8c23b156174db28359e9f93c7378c8 Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volumeAttachment": {"volumeId": "e02f7bbd-a422-4505-b96c-4f2b0b29fd56"}} Jun 28 17:48:58.043389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Cannot 'attach_volume' instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede while it is in vm_state rescued Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'server_id': 'cdf62a85-c4fd-4de1-8b36-5868f2a1fede', 'body': {'volumeAttachment': {'volumeId': 'e02f7bbd-a422-4505-b96c-4f2b0b29fd56'}}} Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:48:58.044810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede while it is in vm_state rescued Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:48:58.050263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede while it is in vm_state rescued Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Returning 409 to user: Cannot 'attach_volume' instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede while it is in vm_state rescued {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1ef5cc0c-b9b9-4779-9515-3e8838c54ace tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069736 Jun 28 17:48:58.053879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 130/254] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:48:57 2022] POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 17:48:58.057534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:58.058071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:58.059916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:58.067538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.068156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.069048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.069517 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.075293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6933cb8f-ebb0-4671-a29e-e4001ce010d8 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.312591 Jun 28 17:48:58.077112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 125/255] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:57 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:48:58.162217 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-21c55d90-0e12-41f6-987d-5e2352a2ce6d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/action" status: 202 len: 0 microversion: 2.1 time: 0.109988 Jun 28 17:48:58.163297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 131/256] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:48:58 2022] POST /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:48:58.175915 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:58.177075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:58.186097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.186729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.187779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.188311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.276004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:58.277613 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:58.287805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.289032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.290846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.291597 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.433085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:58.444953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1286b0a8-83fc-41ee-9b57-1d9f8be06344 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1510 microversion: 2.1 time: 0.276643 Jun 28 17:48:58.445847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 126/257] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:58 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:58.548714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:58.564932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:58.567971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:58.570186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d9a3e733-74d3-4e7e-8b68-7c5046a371a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.301908 Jun 28 17:48:58.571232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 132/258] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:58 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:48:58.657876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:58.662760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:58.688149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.694040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.696121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:58.709306 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:58.716296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:59.031384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:59.049623 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-91c1b826-fa66-4e78-8ebc-df0904741b05 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1359 microversion: 2.1 time: 0.419120 Jun 28 17:48:59.052910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 127/259] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:58 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:59.101839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:59.103747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:59.112417 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.114587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.116114 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.116626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.160363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-8c3c03cc-dc83-4fa1-baba-7d98b7861369 req-9876d913-f0f0-4831-a17f-9c376da1b488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:48:59.178218 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-8c3c03cc-dc83-4fa1-baba-7d98b7861369 req-9876d913-f0f0-4831-a17f-9c376da1b488 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.179109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-8c3c03cc-dc83-4fa1-baba-7d98b7861369 req-9876d913-f0f0-4831-a17f-9c376da1b488 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.195921 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-8c3c03cc-dc83-4fa1-baba-7d98b7861369 req-9876d913-f0f0-4831-a17f-9c376da1b488 service nova] Creating event network-vif-plugged:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:48:59.204325 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-8c3c03cc-dc83-4fa1-baba-7d98b7861369 req-9876d913-f0f0-4831-a17f-9c376da1b488 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048790 Jun 28 17:48:59.205828 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 128/260] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:48:59.407595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:59.416756 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-52d0a650-efad-4d78-8683-65af37bcf686 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.320168 Jun 28 17:48:59.417432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 133/261] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:59 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:48:59.472010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:59.473171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:59.481495 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.482096 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.483248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.483869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.606280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:48:59.612784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:48:59.640632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.643302 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.645944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:48:59.648055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:48:59.806733 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:48:59.852425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0bf94b66-00af-448b-b7f7-3dab2b12f6bc tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1510 microversion: 2.1 time: 0.370871 Jun 28 17:48:59.852425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 129/262] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:48:59 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:00.076246 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:00.078283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:00.092196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.093702 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.095869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.096717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.309822 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.320446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.321605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.322776 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a0ac3502-1d21-497f-b4ec-bc737d848898 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.727099 Jun 28 17:49:00.324669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 134/263] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:48:59 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:49:00.337428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.360816 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7fe49369-f6e9-41a9-beff-58c6271b2536 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1550 microversion: 2.1 time: 0.289788 Jun 28 17:49:00.362196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:00 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1550 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:00.391046 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:00.392125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:00.403933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.404802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.406141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.406693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.441561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:00.443038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:00.459651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.460826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.462517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.479547 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.691184 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.708410 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-946639a2-f304-4956-8216-cce2ca686fca tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1550 microversion: 2.1 time: 0.323474 Jun 28 17:49:00.709784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 135/265] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:00 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1550 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:00.732861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:00.741801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.743547 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Searching by: {'deleted': False, 'project_id': '63b5557298f24f0bb26ce631568ef4f4'} {{(pid=124336) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 28 17:49:00.756973 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.759845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.761891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.762930 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:00.797363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:00.815929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-03140b02-baa9-4250-8108-54206301ecc0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.383688 Jun 28 17:49:00.817350 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 131/266] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:00 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:00.872960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e049cbd3-122c-4218-a0df-82ec84195bcf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:00.884822 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e049cbd3-122c-4218-a0df-82ec84195bcf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:00.885549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e049cbd3-122c-4218-a0df-82ec84195bcf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.044947 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e049cbd3-122c-4218-a0df-82ec84195bcf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Going to try to stop instance {{(pid=124337) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 17:49:01.135263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.multi_cell_list [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124336) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 28 17:49:01.288808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-45457b1f-21b1-44c9-9b9a-a8764f87a9ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.564217 Jun 28 17:49:01.294991 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 136/267] 10.222.0.43 () {58 vars in 1124 bytes} [Tue Jun 28 17:49:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:01.301665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:01.302712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:01.310113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.310654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.312226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.312732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.343716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e049cbd3-122c-4218-a0df-82ec84195bcf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action" status: 202 len: 0 microversion: 2.1 time: 0.477751 Jun 28 17:49:01.344708 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 132/268] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:49:00 2022] POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:49:01.362333 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:01.363541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:01.376098 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.376873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.378234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.378795 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.547521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.559371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-df2c94e6-83d1-4ed8-8e4d-709df0e07150 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1510 microversion: 2.1 time: 0.262473 Jun 28 17:49:01.560872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 137/269] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:01 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:01.569608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:01.570486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:01.579978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.580743 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.581814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.582415 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.631675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.648981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-720c3650-c9da-4a08-b68e-a944e9cf32ef tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1550 microversion: 2.1 time: 0.297178 Jun 28 17:49:01.650223 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 133/270] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:01 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1550 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:01.661855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:01.664969 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:01.680570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.682045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.693022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.694847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.853342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.867511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c808991f-48f4-4b8c-b1a4-dc8e76d3e182 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.304288 Jun 28 17:49:01.868624 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 138/271] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:01 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:01.889055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:01.890065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:01.902792 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.903526 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.905016 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:01.905752 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:01.969076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.985398 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.989932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:01.992915 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c4aa1474-a31f-4c2c-a738-1efd624c5141 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1403 microversion: 2.20 time: 0.340755 Jun 28 17:49:01.994278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 134/272] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:49:01 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1403 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:49:02.296419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:02.302044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:02.310207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bcdfee79-c49f-4a9b-ab85-e6032d03cf12 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.435345 Jun 28 17:49:02.314497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 139/273] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:01 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:02.587091 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:02.588340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:02.643637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:02.646088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:02.649468 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:02.650311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:02.904264 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:02.908714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:02.929175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:02.930658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:02.932759 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:02.933987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:02.979359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:02.997820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3092f591-3fb6-4b30-86cf-fec32d66ef5f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1510 microversion: 2.1 time: 0.420843 Jun 28 17:49:03.005427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 135/274] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:02 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:03.029664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:03.030324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:03.043189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.043682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.045868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.046517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.211838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:03.221133 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:03.223124 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:03.224430 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bca672c9-3932-412a-bb97-4ab4a18e5dcc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1596 microversion: 2.20 time: 0.204117 Jun 28 17:49:03.225032 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 136/275] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:49:03 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1596 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:49:03.239349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:03.243095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:03.243598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:03.248901 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-725bb50d-a09b-43cd-95b5-af02475f3d66 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.356799 Jun 28 17:49:03.249763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 140/276] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:02 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:03.253264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.253842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.254766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.255311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.334955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:03.336056 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:03.347153 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.347954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.349417 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.350197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.357030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-aae596f5-849e-44c6-846f-1989a5d5546f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117735 Jun 28 17:49:03.364141 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 137/277] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Jun 28 17:49:03 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 17:49:03.628741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6163402b-f9e9-4896-b8d6-2b6e794ded92"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:03.629867 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:03.636708 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.637163 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.637989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:03.638411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:03.737120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:03.745340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2001050a-4454-4631-a908-85127284a1f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.417365 Jun 28 17:49:03.746044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 141/278] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:03 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:04.026171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:04.029611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:04.063293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.064333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:04.066338 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.066677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:04.533702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:04.546607 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ee206d0a-e188-4d50-98ad-06b5effb2ad2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1510 microversion: 2.1 time: 0.527138 Jun 28 17:49:04.548299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 142/279] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:04 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:04.556940 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:04.557957 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:04.565835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.566433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:04.567461 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.567999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:04.822764 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:04.833310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5bbb32cb-0353-4db2-9dd1-d17f8249ec31 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.282836 Jun 28 17:49:04.834372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 143/280] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:04 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:04.843314 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:04.844488 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:04.855311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.855955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:04.857095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:04.857650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:05.453657 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-eace1bda-cf67-4fd6-b689-00e45404887f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.829671 Jun 28 17:49:05.456466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 138/281] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:49:03 2022] POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 194 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:05.574851 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:05.575870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:05.583323 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=84 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:05.602076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:05.603574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:05.607362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:05.608699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:05.655983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:05.685295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b54d0a13-c7c3-4f52-9991-0a99f60feedf tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.849547 Jun 28 17:49:05.688256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 144/282] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:04 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:05.868300 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:05.869518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:05.908590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:05.909355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:05.916358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:05.917395 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:05.961671 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:05.980183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-dd0443a8-5051-4719-b0a4-c26d9a07d9b4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1516 microversion: 2.1 time: 0.411139 Jun 28 17:49:05.992458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 139/283] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:05 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:06.003051 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-09556426-2cd7-473b-aaf0-305ed385c8f4 req-15e6c636-52b8-4f78-9f51-ead8d40fff75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:06.027178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-09556426-2cd7-473b-aaf0-305ed385c8f4 req-15e6c636-52b8-4f78-9f51-ead8d40fff75 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:06.028062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-09556426-2cd7-473b-aaf0-305ed385c8f4 req-15e6c636-52b8-4f78-9f51-ead8d40fff75 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:06.055088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-09556426-2cd7-473b-aaf0-305ed385c8f4 req-15e6c636-52b8-4f78-9f51-ead8d40fff75 service nova] Creating event network-changed:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:49:06.082490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-09556426-2cd7-473b-aaf0-305ed385c8f4 req-15e6c636-52b8-4f78-9f51-ead8d40fff75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098054 Jun 28 17:49:06.083621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 140/284] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:06.491610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:06.507731 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d0e33b7a-d8d3-4a07-bb86-73c9a68ba9fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.650517 Jun 28 17:49:06.520933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 145/285] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:05 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:06.720484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:06.721773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:06.746815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:06.747537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:06.749089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:06.750842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:06.957132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:06.970467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-be607674-da8a-4599-8446-f1cb9e8b2a5f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.261511 Jun 28 17:49:06.973083 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 141/286] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:06 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:07.535325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:07.536239 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:07.549229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:07.550528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:07.552724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:07.553512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:07.821723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-773cd2cb-279e-4dd7-869b-58ce15b92bb9 req-e8eb8403-cee1-423a-ac3a-9d2be7e4f8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421913d2-e921-4384-9bdc-50d28ad4760f", "name": "network-vif-plugged", "status": "completed", "tag": "c2aebc18-4fd3-4bd9-a791-18e9f4656b2d"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:07.827582 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:07.836496 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-773cd2cb-279e-4dd7-869b-58ce15b92bb9 req-e8eb8403-cee1-423a-ac3a-9d2be7e4f8f0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:07.840030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8fc3b287-b69e-47c6-bb16-d3ea497918df tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.310664 Jun 28 17:49:07.841217 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 146/287] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:07 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:07.853528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-773cd2cb-279e-4dd7-869b-58ce15b92bb9 req-e8eb8403-cee1-423a-ac3a-9d2be7e4f8f0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:07.861170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9e4d81e6-229f-4c55-bafc-de9a5d262051 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: .version_select at 0x7f577241bd30>, body: {"keypair": {"name": "tempest-keypair-2044326167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvpUIbt1wODfrO/zQzuBPNmwgMv2ZTiozxhw+HcL8iFmupEFST2EaGffg3XuPpUqpX8eHYsBBf8fKmeLIgWuUszCd+KTDSA5FKuNa5K+K0pYJrKUVSvqVnI498R8X5XiQ=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:07.884024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-773cd2cb-279e-4dd7-869b-58ce15b92bb9 req-e8eb8403-cee1-423a-ac3a-9d2be7e4f8f0 service nova] Creating event network-vif-plugged:c2aebc18-4fd3-4bd9-a791-18e9f4656b2d for instance 421913d2-e921-4384-9bdc-50d28ad4760f on hv-cinder-84801 Jun 28 17:49:07.891540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-9e4d81e6-229f-4c55-bafc-de9a5d262051 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:49:07.899301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-773cd2cb-279e-4dd7-869b-58ce15b92bb9 req-e8eb8403-cee1-423a-ac3a-9d2be7e4f8f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081314 Jun 28 17:49:07.902626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 142/288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:07.906862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-9e4d81e6-229f-4c55-bafc-de9a5d262051 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for user 3a8c23b156174db28359e9f93c7378c8 and project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:49:07.951381 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9e4d81e6-229f-4c55-bafc-de9a5d262051 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096745 Jun 28 17:49:07.957516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 147/289] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:49:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:07.994746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:07.995393 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:08.006156 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:08.007426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:08.008984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:08.010255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:08.221044 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:08.224424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:08.233221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d0cad760-f0f9-4491-bc86-24487cc194db tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.242859 Jun 28 17:49:08.234172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 143/290] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:07 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:08.864004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:08.865295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:08.877630 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:08.878506 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:08.880077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:08.880981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:09.104498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:09.127166 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-35d0595e-d531-426e-98d1-3f5356612ae6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.271431 Jun 28 17:49:09.128777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 148/291] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:08 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:09.253324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:09.254076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:09.268161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:09.268161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:09.269019 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:09.269446 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:09.578321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:09.593613 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fb6f25ce-8cfd-49ac-9903-688aef8ac6f0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1314 microversion: 2.1 time: 0.344265 Jun 28 17:49:09.594798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 144/292] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:09 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:10.146186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:10.146992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:10.167727 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:10.169388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:10.171179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:10.173394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:10.240660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-442127200", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91b4b64c-5ea4-45a1-88c6-446aed9004ce"}], "security_groups": [{"name": "tempest-securitygroup--573885032"}], "key_name": "tempest-keypair-2044326167", "user_data": "}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:10.352450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:10.363707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c9655f3d-6b41-4c8f-a73f-6579f36c55f2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.221615 Jun 28 17:49:10.365061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 149/293] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:10 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:10.444586 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] validate_networks() for [('91b4b64c-5ea4-45a1-88c6-446aed9004ce', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:49:10.623953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:10.626015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:10.636037 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:10.636855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:10.637896 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:10.638509 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:10.841405 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:10.847101 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:10.856150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-203be636-7122-4739-b60c-5eaf6abdf9e0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1497 microversion: 2.1 time: 0.240822 Jun 28 17:49:10.869039 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 150/294] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:10 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:11.092697 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:49:11.093547 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:49:11.094564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:49:11.095421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:49:11.096212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:49:11.114143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.114742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.116469 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.116828 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.158727 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:49:11.163548 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Getting quotas for user 3a8c23b156174db28359e9f93c7378c8 and project 54e94e7c524d4bafaf7dd36b7edb48fb. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:49:11.186970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:49:11.189433 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:49:11.249135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-74e93b0d-06a3-46fd-aeec-a1e3f1ee1034 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.012569 Jun 28 17:49:11.250121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 145/295] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:49:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 17:49:11.260486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2818aecb-fc0c-464b-b11a-3f5949910072 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:11.261774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2818aecb-fc0c-464b-b11a-3f5949910072 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:11.391414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:11.392581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:11.394839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2818aecb-fc0c-464b-b11a-3f5949910072 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:11.401442 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.402287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.403266 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.403707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.436520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2818aecb-fc0c-464b-b11a-3f5949910072 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1245 microversion: 2.1 time: 0.179133 Jun 28 17:49:11.437465 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 151/296] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:11 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1245 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:11.609180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:11.618213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f6b3ee91-5827-4ff9-8a45-78c48fab2f45 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.232032 Jun 28 17:49:11.619111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 146/297] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:11 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:11.654237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:11.655203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:11.662903 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.663310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.664352 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.665071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.705900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:49:11.815376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f44b7b80-d587-4f1d-89f2-4fd2c0bfdc6e tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "DELETE /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 204 len: 0 microversion: 2.1 time: 0.166795 Jun 28 17:49:11.816053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 152/298] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:49:11 2022] DELETE /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:49:11.825785 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:11.826465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:11.836550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.837339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:11.838771 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:11.839678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:12.004523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:12.015062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-553b4725-fef4-41ee-8b5c-7a7d9a625da5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1503 microversion: 2.1 time: 0.194561 Jun 28 17:49:12.015674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 147/299] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:11 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:12.466085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:12.468205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:12.476579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:12.477403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:12.478657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:12.479252 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:12.573583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:12.586826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6f9826ba-a764-4051-97a0-7b58b51d1267 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1249 microversion: 2.1 time: 0.126473 Jun 28 17:49:12.587823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 153/300] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:12 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:12.642332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:12.644880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:12.657845 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:12.658677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:12.660347 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:12.661193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:12.854913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:12.870981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a92b48d4-0c49-4872-978c-46337d9f2290 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.237153 Jun 28 17:49:12.871929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 148/301] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:12 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:13.039705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:13.041151 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:13.053183 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.053987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:13.055353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.056111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:13.273773 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:13.283078 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-77235bf1-df25-4c49-b787-22f4202268c3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1503 microversion: 2.1 time: 0.251360 Jun 28 17:49:13.283678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 154/302] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:13 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:13.605530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:13.606176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:13.613858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.614311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:13.615098 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.615527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:13.712249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:13.721119 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7da401df-9755-45da-adf8-b225c312c87b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1249 microversion: 2.1 time: 0.119535 Jun 28 17:49:13.721930 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 149/303] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:13 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:13.889838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:13.892474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:13.906861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.907639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:13.909065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:13.909870 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:14.068917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:14.078095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f728aeb0-3c6e-4869-9157-1d868e908b82 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.192184 Jun 28 17:49:14.079547 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 155/304] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:13 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:14.304876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:14.305592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:14.313363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:14.313714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:14.314894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:14.315342 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:14.761152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:14.762821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:14.782036 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:14.782631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:14.782984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:14.783727 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:14.784449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:14.799313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e0b2e516-2f8f-4f0b-9c0c-42c8237b95f2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1503 microversion: 2.1 time: 0.499884 Jun 28 17:49:14.802210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 150/305] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:14 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:14.981280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:14.995954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:15.004182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b1ce5b8c-1317-44ba-a8c1-5f809bf309f3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1297 microversion: 2.1 time: 0.260556 Jun 28 17:49:15.005180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 156/306] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:14 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1297 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:15.082467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-e9d8724b-7624-46a8-877c-3843429f2ee0 req-a2926cc1-ebb2-49b0-9809-d17abad4b21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421913d2-e921-4384-9bdc-50d28ad4760f", "name": "network-vif-deleted", "tag": "c2aebc18-4fd3-4bd9-a791-18e9f4656b2d"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:15.096437 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-e9d8724b-7624-46a8-877c-3843429f2ee0 req-a2926cc1-ebb2-49b0-9809-d17abad4b21d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.097121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-e9d8724b-7624-46a8-877c-3843429f2ee0 req-a2926cc1-ebb2-49b0-9809-d17abad4b21d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.104026 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:15.104689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:15.113511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.114200 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.115866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.116424 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.117053 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-e9d8724b-7624-46a8-877c-3843429f2ee0 req-a2926cc1-ebb2-49b0-9809-d17abad4b21d service nova] Creating event network-vif-deleted:c2aebc18-4fd3-4bd9-a791-18e9f4656b2d for instance 421913d2-e921-4384-9bdc-50d28ad4760f on hv-cinder-84801 Jun 28 17:49:15.124373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-e9d8724b-7624-46a8-877c-3843429f2ee0 req-a2926cc1-ebb2-49b0-9809-d17abad4b21d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045397 Jun 28 17:49:15.125452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 151/307] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:49:15.326802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:15.336680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a93420d7-0728-4f92-9421-dea066c4af9e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.237049 Jun 28 17:49:15.347712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 157/308] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:15 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:15.738705 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:15.739454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:15.746791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.747236 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.748031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.748700 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.820669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:15.821732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:15.830370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.831322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.832419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.832908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.909429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:15.910334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:15.911338 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lazy-loading 'fault' on Instance uuid 421913d2-e921-4384-9bdc-50d28ad4760f {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:49:16.011859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:16.029484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-acb38887-7186-419c-b9db-6d8156646a26 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1596 microversion: 2.1 time: 0.295495 Jun 28 17:49:16.031590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 152/309] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:15 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1596 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:16.041151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:16.042692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:16.050000 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:16.074865 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-29887308-9013-4073-aebb-696cc9be20d5 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 200 len: 1304 microversion: 2.1 time: 0.258031 Jun 28 17:49:16.077763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 158/310] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:15 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:16.087996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:16.096255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:16.097799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:16.101044 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:16.233684 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:16.247698 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a7c61a09-4397-4769-ae85-d38bafd38834 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1303 microversion: 2.1 time: 0.213826 Jun 28 17:49:16.250046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 153/311] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:16 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1303 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:16.364319 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:16.365790 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:16.383652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:16.384903 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:16.387148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:16.389042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:16.860272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:16.880247 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1361bbf2-b179-4434-b08b-8fdf0c5a56fa tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.528648 Jun 28 17:49:16.881512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 159/312] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:16 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:17.095498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:17.096224 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 421913d2-e921-4384-9bdc-50d28ad4760f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:17.105620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.106405 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:17.107680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.108428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:17.128221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] HTTP exception thrown: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Request method failure captured: Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f HTTP/1.1 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz72NZ497ojZV0xPhbPdvoUVPaGYHZRbWYOFOBz57JIIRFJLWje_SiR6_HWigVjxPAQdhASuR6NdtQ7K5fVMuim_eA_zv5ZYnJznDv4LHz68gzAnF3gZZvcN-bRqsP6onPma4fT3Y9ZdqoBcn04KDccSBUZNWuWVHiiJi4_4Tat8FUY Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 44f4fc9467814b1a8f25d88cd032d9f2 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-VolumesActionsTest-940975844 Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:49:17.129972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44f4fc9467814b1a8f25d88cd032d9f2"}]}] Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-VolumesActionsTest-940975844 Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 44f4fc9467814b1a8f25d88cd032d9f2 Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-VolumesActionsTest-940975844 Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-VolumesActionsTest-940975844-project Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 9a78e8e67c904e7292923e4f0d06f1b6 Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-VolumesActionsTest-940975844-project Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. Jun 28 17:49:17.135422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '421913d2-e921-4384-9bdc-50d28ad4760f'} Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:49:17.137718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. Jun 28 17:49:17.142046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:49:17.151742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Returning 404 to user: Instance 421913d2-e921-4384-9bdc-50d28ad4760f could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:49:17.151742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-63ea8f2d-3225-4746-9d36-570263a2954a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f" status: 404 len: 111 microversion: 2.1 time: 0.041261 Jun 28 17:49:17.151742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 154/313] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:17 2022] GET /compute/v2.1/servers/421913d2-e921-4384-9bdc-50d28ad4760f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:49:17.257608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-168928307", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "networks": [{"uuid": "a752b788-d73b-4672-b906-95074ebc616f"}]}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:17.284493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:17.299109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:17.310255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.311089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:17.312767 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.314180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:17.356655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] validate_networks() for [('a752b788-d73b-4672-b906-95074ebc616f', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:49:17.542972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:17.566053 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-65c1d26d-b185-4976-8daa-c8c38d4553cb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.289152 Jun 28 17:49:17.568248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 155/314] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:17 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:17.901911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:17.903016 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:17.914748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.915499 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:17.918166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:17.919018 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:18.174267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:18.192224 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-98f847e3-60c2-422a-8036-1cfefa9244f3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.293779 Jun 28 17:49:18.193399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 156/315] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:17 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:18.597871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:18.599858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:18.620554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:18.626568 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:18.628087 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:18.629136 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:18.926433 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:18.940244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d689cc3d-ef7a-4161-ac0f-83c8a9a5e964 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.351851 Jun 28 17:49:18.951309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 157/316] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:18 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:19.048361 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:49:19.049651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:49:19.050684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:49:19.051583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:49:19.052326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:49:19.076440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.076859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:19.078050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.078872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:19.115830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Getting quotas for project 44f4fc9467814b1a8f25d88cd032d9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:49:19.129411 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Getting quotas for user 9a78e8e67c904e7292923e4f0d06f1b6 and project 44f4fc9467814b1a8f25d88cd032d9f2. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:49:19.135978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:19.161893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:49:19.167081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:49:19.211824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:19.213150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:19.221388 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.222097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:19.223091 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.223720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:19.260640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f0adc431-301d-4aba-bca8-cec2c862192d tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007894 Jun 28 17:49:19.262630 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 160/317] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:49:19.291478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0ca694ed-aa86-4945-beff-c400fa147a6f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:19.296972 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0ca694ed-aa86-4945-beff-c400fa147a6f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:19.465789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:19.477883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-aff28895-eee6-48f0-8c85-c5a713c2fa1f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.270610 Jun 28 17:49:19.478685 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 158/318] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:19 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:19.588268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0ca694ed-aa86-4945-beff-c400fa147a6f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:19.610645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0ca694ed-aa86-4945-beff-c400fa147a6f tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1213 microversion: 2.1 time: 0.328636 Jun 28 17:49:19.612261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 161/319] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:19 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1213 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:19.957475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:19.958097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:19.982303 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.982748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:19.983986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:19.984763 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.298833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:20.307570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-53cd5b3f-ae67-46f0-8fa3-3844158eddf1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.353829 Jun 28 17:49:20.308720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 159/320] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:19 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:20.395555 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-97ee0a74-462e-49be-8ebf-34c1be3cdb96 req-77604d06-54ff-4b37-a7f0-0167b92c5958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:20.419922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-97ee0a74-462e-49be-8ebf-34c1be3cdb96 req-77604d06-54ff-4b37-a7f0-0167b92c5958 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:20.420726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-97ee0a74-462e-49be-8ebf-34c1be3cdb96 req-77604d06-54ff-4b37-a7f0-0167b92c5958 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.451722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-97ee0a74-462e-49be-8ebf-34c1be3cdb96 req-77604d06-54ff-4b37-a7f0-0167b92c5958 service nova] Creating event network-changed:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:49:20.466392 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-97ee0a74-462e-49be-8ebf-34c1be3cdb96 req-77604d06-54ff-4b37-a7f0-0167b92c5958 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074725 Jun 28 17:49:20.467648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 162/321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:49:20.512347 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:20.513057 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:20.528787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:20.529208 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.530159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:20.530924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.641662 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:20.653888 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:20.680543 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:20.682672 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.686631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:20.694551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:20.789978 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:20.814644 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bb297956-6f28-483c-a18f-1fe3b014af20 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.311110 Jun 28 17:49:20.816503 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 160/322] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:20 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:20.950661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:20.980164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5504f23f-d2f4-4a3b-b1e9-ad08cf62e2fb tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1265 microversion: 2.1 time: 0.352678 Jun 28 17:49:20.985351 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 163/323] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:20 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:21.329049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:21.332339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:21.338914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:21.340627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:21.360140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:21.361356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:21.363166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:21.364711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:21.585529 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:21.600549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2226f798-0531-4fdd-ade5-e70d3a27ca31 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.278617 Jun 28 17:49:21.601659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 161/324] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:21 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:21.837673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:21.838910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:21.865528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:21.866908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:21.869328 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:21.870013 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:22.007719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:22.008738 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:22.016257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:22.016640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:22.017486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:22.017924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:22.035838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:22.096708 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:22.107575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-615c0f51-a5d8-49fb-a6c1-83048353b7d2 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1271 microversion: 2.1 time: 0.103589 Jun 28 17:49:22.108203 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 162/325] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:22 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:22.448948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:22.469692 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d470fbcd-9fbf-475a-ab90-c96ec9cf0cfc tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.639147 Jun 28 17:49:22.484702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 164/326] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:21 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:22.511773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-a3fc8787-02bb-481b-a828-3ade105a2647 req-f479c5d7-2994-43f3-a6cd-923b0d6ea06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:22.522927 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-a3fc8787-02bb-481b-a828-3ade105a2647 req-f479c5d7-2994-43f3-a6cd-923b0d6ea06b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:22.523383 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-a3fc8787-02bb-481b-a828-3ade105a2647 req-f479c5d7-2994-43f3-a6cd-923b0d6ea06b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:22.540465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-a3fc8787-02bb-481b-a828-3ade105a2647 req-f479c5d7-2994-43f3-a6cd-923b0d6ea06b service nova] Creating event network-changed:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:49:22.547788 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-a3fc8787-02bb-481b-a828-3ade105a2647 req-f479c5d7-2994-43f3-a6cd-923b0d6ea06b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045078 Jun 28 17:49:22.549130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 163/327] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:49:22.623666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:22.628292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:22.666475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:22.670011 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:22.676173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:22.678197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:23.087707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:23.102989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-71fc68d6-364a-4a67-babf-fc22e5c2e939 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.487045 Jun 28 17:49:23.104198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 165/328] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:22 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:23.138191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:23.140605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:23.154304 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:23.155865 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:23.159259 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:23.160635 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:23.287794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:23.303642 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-01a88071-acab-41ae-854c-97c365d5adb3 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1271 microversion: 2.1 time: 0.175159 Jun 28 17:49:23.312367 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 164/329] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:23 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:23.496116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:23.496781 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:23.505956 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:23.506714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:23.507686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:23.508315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:23.734157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:23.759146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-179884ba-a2d4-4284-80a1-0e72831ff3bd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.266799 Jun 28 17:49:23.774702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 166/330] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:23 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:24.131827 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:24.133484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:24.151564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.153965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.155202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.157767 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.343520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:24.344949 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:24.358663 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.359306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.370734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.371538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.480363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:24.489885 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c91a2cba-3c09-47bb-a8f7-37ddba6923a8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.364655 Jun 28 17:49:24.499960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 165/331] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:24 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:24.591908 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1790006430"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:24.592403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:24.599156 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.599612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.600435 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.601072 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.841364 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.network.security_group_api [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Adding security group 67db749b-4638-4ac4-82dc-b93923022177 to port 6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 Jun 28 17:49:24.900291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:24.915316 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4dcb877a-d8bf-4e91-8115-307fd5178205 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.586497 Jun 28 17:49:24.917771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 167/332] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:24 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:24.928585 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:24.930528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:24.943946 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.945261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:24.946943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:24.948007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.353514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:25.367723 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a938ed00-63ef-4e05-aa7f-275fb5a96b25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.447924 Jun 28 17:49:25.368416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 168/333] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:24 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:25.426149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e702abbe-9ded-4061-b5f1-e43a7fad6827 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action" status: 202 len: 0 microversion: 2.1 time: 0.836854 Jun 28 17:49:25.432257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 166/334] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:49:24 2022] POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:49:25.438603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:25.439688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-3f1c0981-5d00-4b2c-9774-b2bb7770cc25 req-8da15f2e-673d-4c68-aa89-099c9504078a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:25.440164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:25.452070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-3f1c0981-5d00-4b2c-9774-b2bb7770cc25 req-8da15f2e-673d-4c68-aa89-099c9504078a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.452945 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-3f1c0981-5d00-4b2c-9774-b2bb7770cc25 req-8da15f2e-673d-4c68-aa89-099c9504078a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.454472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.454930 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.457585 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.458050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.472128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-3f1c0981-5d00-4b2c-9774-b2bb7770cc25 req-8da15f2e-673d-4c68-aa89-099c9504078a service nova] Creating event network-changed:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:49:25.480117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-3f1c0981-5d00-4b2c-9774-b2bb7770cc25 req-8da15f2e-673d-4c68-aa89-099c9504078a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045321 Jun 28 17:49:25.481123 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 167/335] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:25.512743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:25.512743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:25.529206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.530178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.531478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.533892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.849093 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:25.862362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-169f4be1-f7ca-4d8d-930b-027204e3f37b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.358526 Jun 28 17:49:25.873881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 168/336] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:25 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:25.897263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-f770a1ce-4f84-4eac-8a1e-ebf04b06da48 req-15b7c432-36bd-4f5f-aa92-c263f9ee7d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8", "tag": "4ac13401-6000-4eb2-867e-b8f603a544ea"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:25.909529 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-f770a1ce-4f84-4eac-8a1e-ebf04b06da48 req-15b7c432-36bd-4f5f-aa92-c263f9ee7d01 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.910356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-f770a1ce-4f84-4eac-8a1e-ebf04b06da48 req-15b7c432-36bd-4f5f-aa92-c263f9ee7d01 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.929821 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-f770a1ce-4f84-4eac-8a1e-ebf04b06da48 req-15b7c432-36bd-4f5f-aa92-c263f9ee7d01 service nova] Creating event network-changed:4ac13401-6000-4eb2-867e-b8f603a544ea for instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 on hv-cinder-84801 Jun 28 17:49:25.943504 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-f770a1ce-4f84-4eac-8a1e-ebf04b06da48 req-15b7c432-36bd-4f5f-aa92-c263f9ee7d01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067959 Jun 28 17:49:25.945042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 169/337] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:25.951676 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:25.952943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:25.960338 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.960920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:25.961818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:25.962520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:26.027095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:26.052724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-13bea6bd-3176-4172-a966-2776d526dfa0 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1762 microversion: 2.1 time: 0.605603 Jun 28 17:49:26.052724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 169/338] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:25 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1762 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:26.259629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:26.279617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-34769c21-1bf1-4313-80c8-3f2078d27691 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.332209 Jun 28 17:49:26.281350 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 170/339] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:25 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:26.386883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:26.388440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:26.397865 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:26.398759 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:26.399864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:26.400682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:26.890337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:26.891638 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:26.904939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:26.906017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:26.907959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:26.909132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:26.980417 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:26.994287 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-71ad0144-95ce-478d-a9c9-d067f1db4e38 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.610573 Jun 28 17:49:26.996521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 170/340] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:26 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:27.151379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:27.162995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9c7f6db7-ae41-4935-8594-073eb499ea01 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.276121 Jun 28 17:49:27.163892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 171/341] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:26 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:27.311718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:27.312329 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:27.320458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:27.320949 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:27.321787 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:27.322236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:27.492632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:27.501996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f4b8c14b-fb03-4c91-a38f-f028ebda2c47 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.195179 Jun 28 17:49:27.502470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 171/342] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:27 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:28.019440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:28.020181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:28.028809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.029358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.030316 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.030811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.188880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:28.190035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:28.201321 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.202133 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.203504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.204224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.216848 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:28.231006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d8f34e24-faf0-43a1-a910-e2a71bfb5c9b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1721 microversion: 2.1 time: 0.215908 Jun 28 17:49:28.231870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 172/343] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:28 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:28.461092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:28.481758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-29819e85-94f1-43f0-b37b-e3835489961d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.298438 Jun 28 17:49:28.492583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 172/344] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:28 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:28.523931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:28.524964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:28.537042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.537797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.538667 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.539297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.653931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-d5cff64b-83e4-44f0-9c2f-4c7532ced55f req-b98b74bd-f2e5-4c89-9295-4e8145b1390b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "name": "network-vif-plugged", "status": "completed", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:28.664899 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d5cff64b-83e4-44f0-9c2f-4c7532ced55f req-b98b74bd-f2e5-4c89-9295-4e8145b1390b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:28.665983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d5cff64b-83e4-44f0-9c2f-4c7532ced55f req-b98b74bd-f2e5-4c89-9295-4e8145b1390b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:28.690658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-d5cff64b-83e4-44f0-9c2f-4c7532ced55f req-b98b74bd-f2e5-4c89-9295-4e8145b1390b service nova] Creating event network-vif-plugged:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:49:28.696641 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-d5cff64b-83e4-44f0-9c2f-4c7532ced55f req-b98b74bd-f2e5-4c89-9295-4e8145b1390b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051335 Jun 28 17:49:28.697256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 173/345] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:28.778682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:28.785204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6c431012-57e4-41f6-be85-894c10d207c1 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.267719 Jun 28 17:49:28.785892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 173/346] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:28 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:29.254525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:29.259750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:29.260462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:29.269077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.269548 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.271142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.271587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.490412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:29.499210 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c1e78194-be3e-44be-8536-1392b2e0252c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1698 microversion: 2.1 time: 0.245583 Jun 28 17:49:29.499789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 174/347] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:29 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1698 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:29.508537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:29.509791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:29.517393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e7980e3a-4aec-4b44-b3e5-cb184598a8b9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:29.517988 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.518406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.519428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.522281 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.530496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e7980e3a-4aec-4b44-b3e5-cb184598a8b9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.531052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e7980e3a-4aec-4b44-b3e5-cb184598a8b9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.603981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=14 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:29.612025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e7980e3a-4aec-4b44-b3e5-cb184598a8b9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Going to try to start instance {{(pid=124336) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 17:49:29.631090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:29.679325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e7980e3a-4aec-4b44-b3e5-cb184598a8b9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action" status: 202 len: 0 microversion: 2.1 time: 0.166228 Jun 28 17:49:29.684584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 175/348] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:49:29 2022] POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:49:29.691825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:29.692551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:29.700358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.701229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.702188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.702700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.770901 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:29.779836 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e733fce6-fa2c-48da-a04f-710468e0acc3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.275116 Jun 28 17:49:29.780503 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 174/349] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:29 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:29.803428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:29.804226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:29.811373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.811829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.812632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:29.813069 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:29.883540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:29.901305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-30ea3ecf-33ad-47b0-906f-c6892121011d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1707 microversion: 2.1 time: 0.213544 Jun 28 17:49:29.902685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 176/350] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:29 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1707 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:30.002376 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:30.013370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-42221e64-5512-435d-9639-08b8ee3547fc tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.214005 Jun 28 17:49:30.014569 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 175/351] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:29 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:30.802350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:30.803504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:30.812815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:30.813439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:30.814525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:30.815011 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:30.920045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:30.921613 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:30.930873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:30.931987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:30.932590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:30.933205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:30.974512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:30.982288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e6b965e2-51a8-454f-a6ea-7850ff87a59b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1370 microversion: 2.1 time: 0.185536 Jun 28 17:49:30.985883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 177/352] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:30 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:31.045805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:31.046430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:31.059464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:31.059464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:31.059464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:31.059464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:31.181428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:31.204894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5ef08dc8-2ff6-4ce8-a302-5eb10cc7e16c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1707 microversion: 2.1 time: 0.289249 Jun 28 17:49:31.206274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 176/353] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:30 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1707 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:31.253404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:31.261681 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c0c540f1-25d7-412b-ac24-b82455727700 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.230215 Jun 28 17:49:31.271984 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 178/354] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:31 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:32.003059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:32.004189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:32.011922 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.012487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.013235 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.014130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.231416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:32.232760 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:32.240928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.241384 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.242188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.242628 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.258321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:32.274969 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-48266f5d-0c39-4b89-a6b9-cecc8857f775 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1564 microversion: 2.1 time: 0.278541 Jun 28 17:49:32.282730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 177/355] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:31 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1564 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:32.292766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:32.293409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:32.301268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.301993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.303109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.303772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.443401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:32.475923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-036933a3-cea5-4015-8f3c-25e11d037687 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1707 microversion: 2.1 time: 0.251185 Jun 28 17:49:32.477050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 179/356] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:32 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1707 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:32.485833 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:32.487440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:32.498183 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.499167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.501077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.502443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.659220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4e945d23-a8cd-4475-ac5d-b0bd2ed87b04 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180117 Jun 28 17:49:32.661501 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 180/357] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:49:32 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:32.843529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-6f565552-ee85-4c81-b0cd-60c679f95a61 req-663ac999-a146-4062-bf29-2c4ce14f846c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8", "name": "network-vif-plugged", "status": "completed", "tag": "4ac13401-6000-4eb2-867e-b8f603a544ea"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:32.855233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6f565552-ee85-4c81-b0cd-60c679f95a61 req-663ac999-a146-4062-bf29-2c4ce14f846c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:32.855676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6f565552-ee85-4c81-b0cd-60c679f95a61 req-663ac999-a146-4062-bf29-2c4ce14f846c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:32.871391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-6f565552-ee85-4c81-b0cd-60c679f95a61 req-663ac999-a146-4062-bf29-2c4ce14f846c service nova] Creating event network-vif-plugged:4ac13401-6000-4eb2-867e-b8f603a544ea for instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 on hv-cinder-84801 Jun 28 17:49:32.877136 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-6f565552-ee85-4c81-b0cd-60c679f95a61 req-663ac999-a146-4062-bf29-2c4ce14f846c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Jun 28 17:49:32.878164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 181/358] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:32.892239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:32.919266 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-68daaf48-64d7-4b89-92f5-1c07ad70e44a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.641183 Jun 28 17:49:32.921182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 178/359] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:32 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:33.496124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:33.496905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:33.504897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:33.505413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:33.506851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:33.506851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:33.760282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:33.769970 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-61854b98-a999-4d53-b853-ce1f6b655f9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1707 microversion: 2.1 time: 0.278795 Jun 28 17:49:33.770861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 182/360] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:33 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1707 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:33.941585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:33.942621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:33.954239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:33.954867 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:33.956121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:33.957240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:34.032698 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-874ac46e-8347-4a1e-b45e-c4985d3a311f req-fcaba35c-3988-4fa7-a93a-def67a812719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:34.062437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-874ac46e-8347-4a1e-b45e-c4985d3a311f req-fcaba35c-3988-4fa7-a93a-def67a812719 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:34.062907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-874ac46e-8347-4a1e-b45e-c4985d3a311f req-fcaba35c-3988-4fa7-a93a-def67a812719 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:34.078784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-874ac46e-8347-4a1e-b45e-c4985d3a311f req-fcaba35c-3988-4fa7-a93a-def67a812719 service nova] Creating event network-changed:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:49:34.086188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-874ac46e-8347-4a1e-b45e-c4985d3a311f req-fcaba35c-3988-4fa7-a93a-def67a812719 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057377 Jun 28 17:49:34.088003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 183/361] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:34.166528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:34.175378 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a1801d9e-f9f5-47d3-aaca-dc0a21ad5bc4 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.240644 Jun 28 17:49:34.175959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 179/362] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:33 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:34.788510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:34.789219 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:34.795931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:34.796416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:34.797189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:34.797630 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:34.958366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:34.968114 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-718df69c-8aef-42b1-bd5e-dc52c77c5591 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1711 microversion: 2.1 time: 0.184357 Jun 28 17:49:34.968763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 184/363] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:34 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1711 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:35.195954 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:35.196799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:35.207441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:35.207881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:35.208713 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:35.209144 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:35.387325 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:35.407263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4c517e42-0fae-421b-b0e9-84476327a802 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1313 microversion: 2.1 time: 0.210971 Jun 28 17:49:35.407263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 180/364] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:35 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:36.426079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:36.426681 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:36.434219 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:36.434682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:36.435553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:36.435986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:36.592069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:36.605884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-aa22b403-8162-4649-9d51-b5602f09a76a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1496 microversion: 2.1 time: 0.183376 Jun 28 17:49:36.617940 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 185/365] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:36 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:37.328990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:37.329629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:37.333183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:37.341786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:37.342359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:37.343223 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:37.343675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:37.360764 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:37.372174 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:49:37.462528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-23eb6650-e7b5-40f7-bae0-54d70ce60657 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 204 len: 0 microversion: 2.1 time: 0.140260 Jun 28 17:49:37.463531 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 181/366] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:49:37 2022] DELETE /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:49:37.473210 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:37.474150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:37.482730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:37.483518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:37.484524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:37.484926 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:37.655040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:37.668739 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6717151d-49d4-4638-9ad0-cde3dbda00ea tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1502 microversion: 2.1 time: 0.199951 Jun 28 17:49:37.669878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 186/367] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:37 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:49:38.695532 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:38.697397 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:38.705337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:38.706154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:38.707012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:38.707654 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:38.925852 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:38.942085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-78274de4-58d8-411b-a058-9fa6eec1c839 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1502 microversion: 2.1 time: 0.250581 Jun 28 17:49:38.943178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 182/368] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:38 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:39.959203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:39.961005 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:39.968222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:39.968710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:39.969504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:39.969935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:40.047662 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:40.060125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c56bd2b9-14e6-4cf5-9b18-6f260701b1d0 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1460 microversion: 2.1 time: 0.104447 Jun 28 17:49:40.070025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 187/369] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:39 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1460 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:40.110244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-95dd3738-ce47-4bed-913f-34211dab5bf3 req-43d5fc2e-ecd5-4bc2-985f-340afeb65f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8", "name": "network-vif-deleted", "tag": "4ac13401-6000-4eb2-867e-b8f603a544ea"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:40.120216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-95dd3738-ce47-4bed-913f-34211dab5bf3 req-43d5fc2e-ecd5-4bc2-985f-340afeb65f0c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:40.120684 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-95dd3738-ce47-4bed-913f-34211dab5bf3 req-43d5fc2e-ecd5-4bc2-985f-340afeb65f0c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:40.141990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-95dd3738-ce47-4bed-913f-34211dab5bf3 req-43d5fc2e-ecd5-4bc2-985f-340afeb65f0c service nova] Creating event network-vif-deleted:4ac13401-6000-4eb2-867e-b8f603a544ea for instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 on hv-cinder-84801 Jun 28 17:49:40.147467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-95dd3738-ce47-4bed-913f-34211dab5bf3 req-43d5fc2e-ecd5-4bc2-985f-340afeb65f0c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040847 Jun 28 17:49:40.148065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 183/370] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:49:41.076904 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:41.077504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:41.084720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:41.085158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:41.085932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:41.086368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:41.150928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:41.159604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e5ebfb28-b428-491c-95f8-c838edac505a tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1460 microversion: 2.1 time: 0.086688 Jun 28 17:49:41.160283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 188/371] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:41 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1460 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:42.182108 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:42.183237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:42.192213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:42.192914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:42.193933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:42.194494 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:42.280833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a78e8e67c904e7292923e4f0d06f1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f4fc9467814b1a8f25d88cd032d9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:42.289530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-33c6e89c-442c-4878-a2a5-290584825d91 tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 200 len: 1298 microversion: 2.1 time: 0.115414 Jun 28 17:49:42.290203 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 184/372] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:42 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:43.313315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:43.313962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] [instance: 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:43.321031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:43.321469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:43.322255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:43.322694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:43.338056 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] HTTP exception thrown: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Request method failure captured: Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 HTTP/1.1 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz72NZ497ojZV0xPhbPdvoUVPaGYHZRbWYOFOBz57JIIRFJLWje_SiR6_HWigVjxPAQdhASuR6NdtQ7K5fVMuim_eA_zv5ZYnJznDv4LHz68gzAnF3gZZvcN-bRqsP6onPma4fT3Y9ZdqoBcn04KDccSBUZNWuWVHiiJi4_4Tat8FUY Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 44f4fc9467814b1a8f25d88cd032d9f2 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesActionsTest-940975844 Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:49:43.339832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44f4fc9467814b1a8f25d88cd032d9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44f4fc9467814b1a8f25d88cd032d9f2"}]}] Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesActionsTest-940975844 Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 44f4fc9467814b1a8f25d88cd032d9f2 Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesActionsTest-940975844 Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesActionsTest-940975844-project Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 9a78e8e67c904e7292923e4f0d06f1b6 Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesActionsTest-940975844-project Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. Jun 28 17:49:43.342580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8'} Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:49:43.344202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. Jun 28 17:49:43.347489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:49:43.349869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] Returning 404 to user: Instance 2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:49:43.349869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9f574c3b-3f87-4ed1-9f81-dbc22fec0d1c tempest-VolumesActionsTest-940975844 tempest-VolumesActionsTest-940975844-project] 10.222.0.43 "GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8" status: 404 len: 111 microversion: 2.1 time: 0.032244 Jun 28 17:49:43.349869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 189/373] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:43 2022] GET /compute/v2.1/servers/2eb4a9f8-f545-4b96-b6c3-00e3a2db13c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:49:55.321000 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:49:55.325815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:55.331850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.332944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.335747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:55.336480 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:55.337476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:55.338073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:55.458946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-891954ba-bd3c-49df-8ee8-6c8a77e62f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action" status: 202 len: 0 microversion: 2.1 time: 0.144172 Jun 28 17:49:55.464440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 185/374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:49:55 2022] POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:49:55.470456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.483601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.499789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:55.499789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:55.547185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:55.547185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:55.547185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:55.547185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:55.754845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:55.765880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9fecf3cf-47f8-4fe6-999f-c11be455a694 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1754 microversion: 2.1 time: 0.299540 Jun 28 17:49:55.778427 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 190/375] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:55 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1754 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:56.794479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:56.795722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:56.808261 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:56.809038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:56.810312 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:56.811067 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:57.133795 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:57.149491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e1ed4bac-2f68-4768-a213-32b57c4b413e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.363431 Jun 28 17:49:57.150768 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 186/376] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:56 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:58.182952 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:58.185437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:58.204776 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:58.205948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:58.207656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:58.208298 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:58.426548 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:58.436723 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b5dcab54-82fc-4b00-aa8f-cb0f6db48b4e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.265637 Jun 28 17:49:58.440874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 191/377] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:58 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:49:59.464128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:49:59.473580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:49:59.504049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:59.505593 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:59.508371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:49:59.510135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:49:59.857386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:49:59.883384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-af0d4cbc-c618-4026-b6ee-05e31f233771 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.429633 Jun 28 17:49:59.884938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 187/378] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:49:59 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:00.917782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:00.920222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:00.932015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:00.933339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:00.935488 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:00.936520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:01.270341 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:01.280048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-db870e1d-9593-4b97-9518-820f463e7f3b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.370516 Jun 28 17:50:01.280682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 192/379] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:00 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:02.300523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:02.301914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:02.311105 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:02.311886 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:02.313045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:02.313678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:02.574176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:02.598604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2ee06264-40b2-427e-8332-daac7d1fdc8b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.304032 Jun 28 17:50:02.603005 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 188/380] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:02 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:03.628070 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:03.628888 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:03.635564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:03.636412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:03.637632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:03.638277 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:03.917809 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:03.929721 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-877f5005-8b56-4cd9-b9c5-1327871dcdd7 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.306772 Jun 28 17:50:03.931161 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 193/381] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:03 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:04.165461 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-230304085", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "networks": [{"uuid": "9c0c055e-3a8e-49d7-929a-475900bc6fda"}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:04.245643 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] validate_networks() for [('9c0c055e-3a8e-49d7-929a-475900bc6fda', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:50:04.800310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:50:04.801729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:50:04.802838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:50:04.803850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:50:04.805094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:50:04.823770 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:04.825169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:04.826928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:04.827964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:04.864365 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Getting quotas for project d8293e6549634daab6d74028a64442db. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:50:04.869726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Getting quotas for user 5b2c082e20fe4ab2a739d8e671816e63 and project d8293e6549634daab6d74028a64442db. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:50:04.888277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:50:04.891968 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:50:04.960020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:04.961907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:04.979697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:04.984253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3c4bb74e-d6bd-4ad8-917b-c6f6ab183daa tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826073 Jun 28 17:50:04.992834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 189/382] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:50:04.998712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:04.999234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-493eeaa0-84f1-4a08-92ed-7d94fb78ecca tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:05.000153 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-493eeaa0-84f1-4a08-92ed-7d94fb78ecca tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:05.002897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:05.003910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:05.106126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-493eeaa0-84f1-4a08-92ed-7d94fb78ecca tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:05.116240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-493eeaa0-84f1-4a08-92ed-7d94fb78ecca tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1218 microversion: 2.1 time: 0.121944 Jun 28 17:50:05.123416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 190/383] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:04 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:05.251855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:05.264130 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7b452cb8-17ec-4dce-9697-5c38e0dcc250 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.308043 Jun 28 17:50:05.265536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 194/384] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:04 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:50:06.134657 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:06.135554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:06.142814 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:06.143170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:06.144176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:06.144410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:06.213535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:06.223606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fd53031d-f05a-47d2-93b9-f7347ee5da86 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1270 microversion: 2.1 time: 0.092870 Jun 28 17:50:06.224198 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 191/385] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:06 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:06.287702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:06.289025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:06.300436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:06.300860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:06.301706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:06.302226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:06.529291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:06.559173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2012a6ad-f602-434b-839b-e91cdfd66f7e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.278899 Jun 28 17:50:06.576890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 195/386] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:06 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:07.242070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:07.242750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:07.251584 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:07.252138 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:07.253091 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:07.253601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:07.357760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:07.366255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f12cddbb-4925-4902-9818-b894451b66f3 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1276 microversion: 2.1 time: 0.128281 Jun 28 17:50:07.366850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 192/387] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:07 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:07.587272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:07.587931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:07.595516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:07.595992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:07.596891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:07.597369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:07.776010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:07.784478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c8d56433-19be-4686-9a83-12772239320b tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.201156 Jun 28 17:50:07.785108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 196/388] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:07 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:08.265476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-491a0f44-1b6a-4426-9da3-2d563837240f req-18d6bd73-30b9-43f6-8f1c-7afbb1cdc5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a38fe61b-9245-4e9b-88ed-5c9a003554a3", "tag": "d9afef26-579a-4cbf-a21c-4278e1c0f348"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:08.275714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-491a0f44-1b6a-4426-9da3-2d563837240f req-18d6bd73-30b9-43f6-8f1c-7afbb1cdc5e6 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:08.276508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-491a0f44-1b6a-4426-9da3-2d563837240f req-18d6bd73-30b9-43f6-8f1c-7afbb1cdc5e6 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:08.296588 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-491a0f44-1b6a-4426-9da3-2d563837240f req-18d6bd73-30b9-43f6-8f1c-7afbb1cdc5e6 service nova] Creating event network-changed:d9afef26-579a-4cbf-a21c-4278e1c0f348 for instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 on hv-cinder-84801 Jun 28 17:50:08.310708 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-491a0f44-1b6a-4426-9da3-2d563837240f req-18d6bd73-30b9-43f6-8f1c-7afbb1cdc5e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050191 Jun 28 17:50:08.311343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 193/389] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:50:08.392768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:08.394027 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:08.405115 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:08.405706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:08.406701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:08.407344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:08.581890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:08.592168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1daaa58e-3483-419a-820a-9b326e586387 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.209804 Jun 28 17:50:08.593848 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 197/390] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:08 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:08.805431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:08.806288 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:08.822330 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:08.822903 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:08.823784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:08.824288 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:09.043800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:09.044481 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:09.044693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:09.052474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:09.052937 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:09.054056 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:09.054726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:09.062058 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-23355942-a042-4b56-8fb2-cb4e2f55beda tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.262737 Jun 28 17:50:09.064885 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 194/391] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:08 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:09.087575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9718763d-a637-4687-b6ae-d38c1a964951 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/ips" status: 200 len: 153 microversion: 2.20 time: 0.048875 Jun 28 17:50:09.088332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 198/392] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Jun 28 17:50:09 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:50:09.618162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:09.618720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:09.626264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:09.626772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:09.627649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:09.628090 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:09.797874 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:09.808365 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7bda3f18-9bf6-44c5-8309-4b04662531d8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.193928 Jun 28 17:50:09.809598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 195/393] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:09 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:10.085594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:10.086179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:10.093452 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:10.093925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:10.094706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:10.095196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:10.255508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:10.263877 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1816f80f-595c-4c6c-b9c0-a38dff55a730 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.182240 Jun 28 17:50:10.264963 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 199/394] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:10 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:10.830182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:10.831310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:10.839742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:10.840659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:10.841677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:10.842273 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.093082 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:11.101961 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4faeb2fc-6e1d-4bc2-bbd1-8a27d47429b2 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.277056 Jun 28 17:50:11.102618 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 196/395] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:10 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:11.263927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:11.265030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:11.273192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.273389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.274358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.274798 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.284125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:11.284856 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:11.294411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.296325 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.297233 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.297674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.306795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lazy-loading 'flavor' on Instance uuid f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:50:11.481032 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:11.491205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-484bb297-4296-461d-a85c-a2bfabd4e83f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.213050 Jun 28 17:50:11.492598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 197/396] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:11 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:11.656576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5bdfb06c-a839-487d-a100-246d0b1b39ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.397699 Jun 28 17:50:11.660432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 200/397] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 28 17:50:11 2022] POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:50:11.666443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:11.667284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:11.677840 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.678269 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.679054 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:11.679567 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:11.852934 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:11.862238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:11.863741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:11.865013 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-868dab14-32f1-44c3-ad02-a50fd7915ffb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.203193 Jun 28 17:50:11.865570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 198/398] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:11 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:50:12.120609 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:12.121391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:12.128114 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.128611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:12.129392 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.129830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:12.274176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:12.283474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ce11f525-ecf3-442f-8564-9f4a6521fe3a tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.167198 Jun 28 17:50:12.284059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 201/399] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:12 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:12.510450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:12.511092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:12.518941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.519311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:12.520081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.521146 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:12.705271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:12.713738 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f9d6ba8e-07d3-4d8d-8e0e-299a9c70a8fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1759 microversion: 2.1 time: 0.207931 Jun 28 17:50:12.714344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 199/400] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:12 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:12.890593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:12.891699 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:12.903215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.904064 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:12.905660 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:12.906454 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:13.059300 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:13.069271 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:13.071550 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:13.072956 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f8e2b1f2-4a7c-42ec-afdf-548d69e5a3e4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.190160 Jun 28 17:50:13.073536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 202/401] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:12 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:13.304449 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:13.305447 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:13.314909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:13.315450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:13.316365 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:13.317002 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:13.527031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:13.535431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0d494133-681f-4901-b2ac-10dc7e4f1249 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.235556 Jun 28 17:50:13.536047 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 200/402] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:13 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:13.732444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:13.733285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:13.739957 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:13.740415 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:13.741272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:13.741744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:13.962598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:13.972130 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f2043ae3-7d52-4c5d-b739-9a1e87104083 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1762 microversion: 2.1 time: 0.244440 Jun 28 17:50:13.972754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 203/403] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:13 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1762 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:14.091789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:14.092458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:14.099289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:14.099739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:14.100542 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:14.100981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:14.259387 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:14.269592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:14.271663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:14.273630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ed8fe360-eaa7-4ffb-9bb8-5c8825d9b75c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.185399 Jun 28 17:50:14.274206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 201/404] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:14 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:14.560990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:14.561615 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:14.568715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:14.569142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:14.569945 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:14.570378 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:14.714263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-5acdcaf5-080f-4c4c-82aa-2eb4fe4ef2b2 req-054a13f8-9ce8-4b7a-ad91-ea938204219e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38fe61b-9245-4e9b-88ed-5c9a003554a3", "name": "network-vif-plugged", "status": "completed", "tag": "d9afef26-579a-4cbf-a21c-4278e1c0f348"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:14.725340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5acdcaf5-080f-4c4c-82aa-2eb4fe4ef2b2 req-054a13f8-9ce8-4b7a-ad91-ea938204219e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:14.725868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5acdcaf5-080f-4c4c-82aa-2eb4fe4ef2b2 req-054a13f8-9ce8-4b7a-ad91-ea938204219e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:14.725999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:14.733275 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:14.739278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-5acdcaf5-080f-4c4c-82aa-2eb4fe4ef2b2 req-054a13f8-9ce8-4b7a-ad91-ea938204219e service nova] Creating event network-vif-plugged:d9afef26-579a-4cbf-a21c-4278e1c0f348 for instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 on hv-cinder-84801 Jun 28 17:50:14.745118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-48d73ada-c548-4004-9b90-098877c5196d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.188012 Jun 28 17:50:14.745600 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-5acdcaf5-080f-4c4c-82aa-2eb4fe4ef2b2 req-054a13f8-9ce8-4b7a-ad91-ea938204219e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Jun 28 17:50:14.746344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 204/405] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:14 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:14.747194 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 202/406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:50:15.293147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:15.293789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:15.303696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:15.304191 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:15.305492 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:15.306015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:15.454527 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:15.463676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:15.471856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:15.471856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-10ab929d-d427-437e-b575-7125c3011483 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.178236 Jun 28 17:50:15.471856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 205/407] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:15 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:15.768300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:15.770084 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=8 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:15.776282 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:15.777369 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:15.785336 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:15.785776 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:15.786552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:15.786984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:15.812145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:15.945511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:15.953725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ff9acdd2-a72c-4f68-ad8b-1966a02edb96 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1318 microversion: 2.1 time: 0.186559 Jun 28 17:50:15.954321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 203/408] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:15 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:16.485371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:16.486086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:16.503206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:16.504004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:16.505072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:16.505666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:16.666730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:16.674941 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:16.676512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:16.677679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-034fb1ec-41a4-4a3d-9772-f4a85b0c8fed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.196688 Jun 28 17:50:16.678242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 206/409] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:16 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:16.971563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:16.972194 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:16.980714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:16.981431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:16.983009 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:16.983498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:17.409589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:17.419135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-efbcd0d0-a153-428a-91ff-17761dafcefb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1506 microversion: 2.1 time: 0.451614 Jun 28 17:50:17.420485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 204/410] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:16 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:17.701497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:17.702760 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:17.712958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:17.713535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:17.714551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:17.715097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:17.898362 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:17.907180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:17.909555 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:17.910971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1efd2084-1f70-4123-8550-4b3f1a2943d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.218036 Jun 28 17:50:17.911884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 207/411] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:17 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:18.929906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:18.930631 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:18.938263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:18.938727 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:18.939514 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:18.939946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:19.106948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:19.115996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:19.117783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:19.118958 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1779394c-c3a8-465b-9db0-7395d22ea488 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.193162 Jun 28 17:50:19.119516 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 205/412] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:18 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:20.139055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:20.139666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:20.147186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:20.147636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:20.148458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:20.148901 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:20.302802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:20.312626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:20.314213 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:20.315500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cfdc9b01-07dc-457c-a797-57d072eb7cdc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.181649 Jun 28 17:50:20.316171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 208/413] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:20 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:21.335932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:21.336970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:21.344337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:21.344792 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:21.345610 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:21.346078 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:21.506311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:21.515453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:21.517013 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:21.518212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e86a67d1-3a8d-40ce-a0b2-96ff96e2e7d9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.186607 Jun 28 17:50:21.519244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 206/414] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:21 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:22.537744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:22.538328 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:22.547148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:22.547827 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:22.549015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:22.549694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:22.713412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:22.722145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:22.723632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:22.724817 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-75fb6390-7ea1-48f4-8e67-71f10b5310d7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.191537 Jun 28 17:50:22.725365 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 209/415] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:22 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:23.743742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:23.744448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:23.751818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:23.752334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:23.754166 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:23.755098 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:23.903508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:23.913154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:23.914743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:23.915959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9fcfc2d2-35a3-4b02-b0be-4d796cc4f6fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.176271 Jun 28 17:50:23.916559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 207/416] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:23 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:24.934824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:24.935433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:24.943665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:24.944107 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:24.944909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:24.945340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:25.049889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:25.050640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:25.063106 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:25.063560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:25.064335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:25.064797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:25.124689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:25.134807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:25.136295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:25.137609 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-516528f0-f70f-44bd-a34a-95ce0efb2f12 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.206810 Jun 28 17:50:25.138354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 210/417] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:24 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:25.210102 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lazy-loading 'services' on Instance uuid 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:50:25.348705 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9ce3606b-c7e2-4e86-9132-3649c47c4381 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments/75a5013a-986a-4c3f-a192-933de161200e" status: 202 len: 0 microversion: 2.1 time: 0.304169 Jun 28 17:50:25.352527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 208/418] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:50:25 2022] DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments/75a5013a-986a-4c3f-a192-933de161200e => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:50:26.159956 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:26.160553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:26.162896 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=43 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:26.169156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:26.169611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:26.170391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:26.170822 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:26.328543 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:26.341678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:26.345118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:26.347277 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-32b35ce6-50ec-45c6-98a2-b29fcdd9b522 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.191238 Jun 28 17:50:26.348281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 211/419] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:26 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:27.369367 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:27.370010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:27.371996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:27.378545 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:27.378979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:27.379783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:27.380216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:27.550157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:27.559461 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:27.560990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:27.561835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-730d256e-a876-4e45-84de-741329b294f1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:27.562351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f97e253a-4f6b-4fcc-97e1-aa1b400587e5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.198103 Jun 28 17:50:27.562718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 209/420] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:27 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:27.570193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-730d256e-a876-4e45-84de-741329b294f1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:27.570193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-730d256e-a876-4e45-84de-741329b294f1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:27.594609 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-730d256e-a876-4e45-84de-741329b294f1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Going to try to stop instance {{(pid=124336) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 17:50:27.653211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-730d256e-a876-4e45-84de-741329b294f1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action" status: 202 len: 0 microversion: 2.1 time: 0.096110 Jun 28 17:50:27.654092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 212/421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:50:27 2022] POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:50:27.664415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:27.665473 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:27.672351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:27.672873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:27.673615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:27.674052 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:27.819939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:27.828246 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-23d306f5-973b-4bdf-9dcc-3d293a16fb24 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.168913 Jun 28 17:50:27.832264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 210/422] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:27 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:28.582173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:28.582892 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:28.591041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:28.591493 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:28.592254 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:28.592718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:28.849824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:28.850453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:28.858066 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:28.858880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:28.859926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:28.860374 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:28.992094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:29.001383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:29.002999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:29.004410 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-98f95c38-481a-4b8e-a680-a58a6efeaa8f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.427055 Jun 28 17:50:29.005168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 213/423] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:28 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:29.033232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:29.042796 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bc9d52c0-7906-4d42-bf04-e205c5132d08 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.196901 Jun 28 17:50:29.043518 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 211/424] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:28 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:50:29.656696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c16e92-c412-44af-a428-3085ae78b9d4"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:29.657983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:29.667312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:29.667754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:29.668561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:29.668997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:29.985871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-116dfc3b-6db8-4fec-bb4b-0caa5e55d01d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335008 Jun 28 17:50:29.986710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 214/425] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:50:29 2022] POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:50:30.024972 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:30.025594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:30.033562 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:30.034210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:30.035279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:30.036440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:30.062675 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:30.063444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:30.071681 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:30.072242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:30.072981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:30.073401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:30.212489 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:30.222512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:30.224375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:30.225901 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-36f44cde-cba5-4d04-aafd-46c36f46442e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.206318 Jun 28 17:50:30.226472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 212/426] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:30 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:30.269555 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:30.277729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3b15182f-2712-4eac-bc88-c4ac19f16b8b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.219680 Jun 28 17:50:30.278312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 215/427] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:30 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:50:31.244921 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:31.245574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:31.253152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:31.253604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:31.254597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:31.255069 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:31.295205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:31.295832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:31.303205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:31.303661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:31.304591 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:31.305030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:31.403121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:31.411691 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:31.413320 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:31.414562 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3176ae11-dff0-4be7-b3f6-4461b7326e94 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.173668 Jun 28 17:50:31.415211 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 213/428] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:31 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:31.452894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:31.460923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-20e3141e-36ef-45cd-ae22-41bea541e58f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.169889 Jun 28 17:50:31.461542 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 216/429] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:31 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:32.436411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:32.437076 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:32.447243 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:32.447881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:32.449105 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:32.449726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:32.478761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:32.480272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:32.487930 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:32.488352 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:32.489226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:32.489667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:32.603188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:32.614193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:32.615705 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:32.617145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-278dbc3c-4f1c-404a-ac19-f1f2e8f65eea tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.186090 Jun 28 17:50:32.617728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 214/430] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:32 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:32.634887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:32.642864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ff84f0ae-37f2-4f5c-a4bb-bc789df3a34a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.168538 Jun 28 17:50:32.643715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 217/431] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:32 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:33.635651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:33.636289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:33.644152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:33.644662 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:33.645890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:33.646326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:33.660936 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:33.661551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:33.668654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:33.669135 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:33.669998 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:33.670520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:33.804586 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:33.813731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:33.813992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:33.815345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:33.816611 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b8ca51c0-4235-4664-aca2-25d3a8462e4a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1742 microversion: 2.20 time: 0.185231 Jun 28 17:50:33.817189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 215/432] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:33 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:33.824732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-29badc1f-7146-4df8-83e9-305468db6eb5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.165100 Jun 28 17:50:33.824732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 218/433] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:33 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:34.837111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:34.837928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:34.840472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:34.841021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:34.846585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:34.847217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:34.848177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:34.848450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:34.853387 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:34.853800 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:34.854586 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:34.855038 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:34.867130 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:35.007911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:35.021778 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:35.023787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:35.025160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5b5aa10d-4285-49bd-a151-5962aa0f6a99 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1742 microversion: 2.20 time: 0.193701 Jun 28 17:50:35.028206 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 216/434] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:34 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:35.032529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:35.041744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7cb83f28-7167-49d1-be3d-866994394427 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.205590 Jun 28 17:50:35.042375 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 219/435] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:34 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:50:36.045732 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:36.046339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:36.054474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:36.054949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:36.055720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:36.056336 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:36.061685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:36.062332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:36.069633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:36.070075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:36.070845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:36.071282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:36.207735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:36.214115 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:36.216651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:36.218145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:36.219312 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8916ba9b-ed88-45bc-90d6-02469bd63a2e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1742 microversion: 2.20 time: 0.177688 Jun 28 17:50:36.219942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 217/436] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:36 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:36.222193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c748f9f2-9b9c-46e5-847a-fb1002bdfe21 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.164255 Jun 28 17:50:36.222993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 220/437] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:36 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:36.816559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-4d697e87-969a-4fc8-89a3-ee97387cd372 req-46d21545-f0f2-4bf7-8c2a-e314dee57253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:36.827464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-4d697e87-969a-4fc8-89a3-ee97387cd372 req-46d21545-f0f2-4bf7-8c2a-e314dee57253 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:36.827906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-4d697e87-969a-4fc8-89a3-ee97387cd372 req-46d21545-f0f2-4bf7-8c2a-e314dee57253 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:36.841274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-4d697e87-969a-4fc8-89a3-ee97387cd372 req-46d21545-f0f2-4bf7-8c2a-e314dee57253 service nova] Creating event network-vif-plugged:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:50:36.846672 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-4d697e87-969a-4fc8-89a3-ee97387cd372 req-46d21545-f0f2-4bf7-8c2a-e314dee57253 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Jun 28 17:50:36.847274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 218/438] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:50:37.238871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:37.240158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:37.241910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:37.243395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:37.248317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.248804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.249667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.250010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.252508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.252961 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.253750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.254180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.432704 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:37.445625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:37.447978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:37.449022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:37.449575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-449542e3-3e18-4280-87aa-f6ed50a03554 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.214694 Jun 28 17:50:37.457226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8cf5003a-bcd1-430f-8cfb-c8b1f8053559 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.221234 Jun 28 17:50:37.467062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 219/439] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:37 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:37.467198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 221/440] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:37 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:37.575764 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:37.576952 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:37.585615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.586423 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.587836 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.588697 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.595985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:37.636418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'flavor' on Instance uuid 01690edf-8c3b-45d7-b6f3-f4e53a333c04 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:50:37.816268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-96ea9d9d-9d23-401d-a7ec-7a355ff4f895 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/action" status: 200 len: 32 microversion: 2.1 time: 0.244410 Jun 28 17:50:37.827894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 220/441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:50:37 2022] POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:50:37.829090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:37.830122 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:37.841000 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.846025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:37.847325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:37.847780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:38.012085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:38.021939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f7d80c7e-020f-49de-bf78-68dd769ceea2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.198549 Jun 28 17:50:38.036417 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 222/442] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:37 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:38.474928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:38.475491 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:38.476280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:38.476693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:38.483460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:38.483935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:38.484071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:38.484401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:38.485173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:38.485276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:38.485738 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:38.485917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:38.647855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:38.664913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-646a9b03-478b-4dbf-8cbc-033e47b6f620 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.193756 Jun 28 17:50:38.666371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 223/443] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:38 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:38.728996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:38.740330 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:38.741948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:38.743563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2b1a5642-1828-49bd-a750-e86186d05bdd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.275834 Jun 28 17:50:38.755900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 221/444] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:38 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:39.050019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:39.050620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:39.074190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.074557 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.075475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.077789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.240249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:39.251807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2d9e100e-4943-4b98-9b65-966daa367698 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.206187 Jun 28 17:50:39.252401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 224/445] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:39 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:39.685960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:39.686526 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:39.696337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.697123 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.697786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.698226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.762755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:39.763508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:39.787945 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.788702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.789747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:39.790400 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:39.926651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:39.941728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-51235a28-23a5-4d32-9e1f-e3f268629a94 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.261449 Jun 28 17:50:39.944822 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 222/446] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:39 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:40.009498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:40.019182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:40.021081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:40.022260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-605a0ef8-bfb4-43fd-9703-88feb7482f48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.263721 Jun 28 17:50:40.033012 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 225/447] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:39 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:50:40.191170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac73bf5-f755-43e5-b189-6244040e83e3", "device": "/dev/sdb"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:40.193182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:40.199971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.200440 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:40.201215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.201835 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:40.272239 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:40.273115 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:40.296837 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.297302 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:40.298717 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.299478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:40.537010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:40.556654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a0f928d0-0413-417c-9625-75b85bc97e1a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.290559 Jun 28 17:50:40.558268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 226/448] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:40 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:40.575147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bc90f6ef-78ff-4cf3-b16b-f86134eabec9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "POST /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387754 Jun 28 17:50:40.576085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 223/449] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:50:40 2022] POST /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:50:40.959931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:40.960643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:40.967028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.967482 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:40.968263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:40.968724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:41.044716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:41.046219 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:41.061096 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:41.062082 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:41.063142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:41.066497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:41.163332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:41.173711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-857b61a3-471b-46df-b8b9-352938b7fdcd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.217885 Jun 28 17:50:41.175313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 227/450] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:40 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:41.276922 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:41.286702 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:41.288245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:41.289983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-32794de2-50bf-438c-89b0-89dc0345be78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.249728 Jun 28 17:50:41.291119 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 224/451] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:41 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:41.583189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:41.583847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:41.591924 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:41.592436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:41.593273 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:41.593697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:41.764709 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:41.772355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-23cc86fc-6ac6-4968-99ce-ca793f50331a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.197510 Jun 28 17:50:41.773054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 228/452] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:41 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:42.199024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:42.199653 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:42.207126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.207660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:42.208929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.209591 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:42.311726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:42.312618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:42.322882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.322882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:42.322882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.322882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:42.449976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:42.472030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b3faa4f6-8f87-4467-95b2-2aa2f1827356 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1675 microversion: 2.1 time: 0.283473 Jun 28 17:50:42.473729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 225/453] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:42 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:42.584153 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:42.596311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:42.601508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:42.604916 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b28df91c-16c1-4b3f-bb93-d3ff6a45ba42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.296363 Jun 28 17:50:42.616758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 229/454] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:42 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:50:42.795102 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:42.798418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:42.812179 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.812818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:42.821182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:42.821880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.012302 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:43.022429 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-68ee8b94-d5e1-4c7b-a717-b118fc700396 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.235304 Jun 28 17:50:43.023207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 226/455] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:42 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:43.489969 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:43.490816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:43.506232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.506921 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.507755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.508193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.638028 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:43.639459 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:43.652847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.653864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.655035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.656370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.717967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:43.739413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0cf04d7c-d188-4cf9-af2a-e6065b9f980a tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1652 microversion: 2.1 time: 0.254297 Jun 28 17:50:43.740408 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 230/456] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:43 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1652 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:43.758546 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fe47e48-c078-4a5d-ba1c-04c74ec228d5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:43.771584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fe47e48-c078-4a5d-ba1c-04c74ec228d5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.772335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fe47e48-c078-4a5d-ba1c-04c74ec228d5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.805550 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5fe47e48-c078-4a5d-ba1c-04c74ec228d5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Going to try to start instance {{(pid=124336) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 17:50:43.890342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5fe47e48-c078-4a5d-ba1c-04c74ec228d5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action" status: 202 len: 0 microversion: 2.1 time: 0.135470 Jun 28 17:50:43.894399 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 231/457] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:50:43 2022] POST /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:50:43.894685 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:43.901581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:43.902414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:43.914425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.914777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.916262 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:43.917253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:43.926755 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:43.928231 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:43.935092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-852e9845-7c56-478c-9497-880ff22411b2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.305399 Jun 28 17:50:43.951150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 227/458] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:43 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:50:44.051637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:44.052415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:44.089146 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:44.089601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:44.090391 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:44.093024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:44.186479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:44.198778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-28f1a591-99ce-4a73-812b-897bb144ee2b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1661 microversion: 2.1 time: 0.302085 Jun 28 17:50:44.208976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 232/459] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:43 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1661 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:44.343735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:44.356858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-565de51a-66ff-4d7f-bb36-66082cc9619f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.321101 Jun 28 17:50:44.368480 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 228/460] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:44 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:44.953859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:44.954783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:44.973041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:44.975003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:44.981045 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:44.981713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:45.180739 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:45.189708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:45.191522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:45.192895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7eb06ac9-5ea7-4194-bb02-7627878e1abd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.243145 Jun 28 17:50:45.193666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 233/461] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:44 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:50:45.216536 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:45.217173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:45.227000 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:45.227453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:45.228243 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:45.228712 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:45.376315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:45.376966 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:45.385016 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:45.385460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:45.389167 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:45.393018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:45.397966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-af9cea1b-d0fa-4d8e-84b6-c99e57045746 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1661 microversion: 2.1 time: 0.185330 Jun 28 17:50:45.398985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:45.402642 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 229/462] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:45 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1661 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:45.560798 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:45.564574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:45.570617 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c78c2abf-636e-425f-a281-442a98b15de4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.198515 Jun 28 17:50:45.572244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 234/463] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:45 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:50:46.214039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:46.215677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:46.222977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.224582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.225728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.226351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.384326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:46.399644 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:46.402877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:46.404786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-529407cd-12ca-4f4b-9838-a5fe102d7fa5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.196469 Jun 28 17:50:46.415598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 230/464] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:46 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:46.421127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:46.422358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:46.434379 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.434883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.435684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.436132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.589343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:46.590512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:46.600526 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.601867 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.603085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:46.603776 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:46.665693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:46.679683 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a6bf064e-f936-49df-95e3-3bbfc864f03f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1665 microversion: 2.1 time: 0.261989 Jun 28 17:50:46.680680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 235/465] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:46 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1665 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:46.790391 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:46.799747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ce468463-01ab-4af0-bd14-d0d223b0d603 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.214663 Jun 28 17:50:46.808982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 231/466] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:46 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:47.427122 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:47.428216 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:47.442920 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:47.443710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:47.445222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:47.446040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:47.669909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:47.688486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:47.692690 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:47.695420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-edeb0688-944d-4b8c-944b-00075f5376b3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.275476 Jun 28 17:50:47.696207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 236/467] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:47 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:47.820274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:47.821139 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:47.828913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:47.829376 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:47.830349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:47.831089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:48.029474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:48.040354 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fb8d298f-37a1-4fe3-93e0-bcd53897dbf3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.224160 Jun 28 17:50:48.041673 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 232/468] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:47 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:48.717890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:48.718477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:48.725416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:48.725863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:48.727413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:48.727832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:48.869684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:48.878431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:48.880244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:48.881423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c075b626-fb3f-4608-b1af-60a91e44ea9d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1737 microversion: 2.20 time: 0.167540 Jun 28 17:50:48.882171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 237/469] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:48 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:49.058358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:49.058942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:49.066527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:49.066980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:49.067773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:49.068204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:49.088314 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:49.224887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:49.237904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-30f18c6e-314f-44ce-9a40-e3c5d580d511 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.183167 Jun 28 17:50:49.238829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 233/470] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:49 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:49.901175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:49.901820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:49.909038 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:49.909650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:49.910854 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:49.910854 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:50.062292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:50.071595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:50.073156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:50.074354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-164a6077-9d35-43b1-8379-94943374376e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.177774 Jun 28 17:50:50.074915 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 238/471] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:49 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:50.257960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:50.258605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:50.266029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:50.266477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:50.267251 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:50.267871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:50.417604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:50.426274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e11a92da-c390-4d23-b803-58e2196418a2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.172394 Jun 28 17:50:50.426859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 234/472] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:50 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:51.093703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:51.094315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:51.103024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:51.103480 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:51.104462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:51.105119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:51.248832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:51.258367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:51.260787 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:51.262060 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4f704584-b926-4b70-9f57-1fb3cbe7e2cd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.172736 Jun 28 17:50:51.262635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 239/473] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:51 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:51.444620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:51.445566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:51.453496 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:51.454026 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:51.454939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:51.455449 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:51.595680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:51.604195 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b215fce1-6aae-45fc-82f1-1f4ed8624d11 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.164158 Jun 28 17:50:51.604815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 235/474] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:51 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:52.284000 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:52.284705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:52.293275 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:52.293989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:52.295006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:52.295782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:52.460108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:52.477010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:52.480192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:52.482472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7fd8134b-ef54-411f-8357-eaac9b52eaff tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.202088 Jun 28 17:50:52.483501 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 240/475] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:52 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:52.621711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:52.622585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:52.629907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:52.630361 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:52.631131 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:52.631569 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:52.782478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:52.792958 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-160e609d-f726-4a76-ab5d-11d1792f9d1d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.175066 Jun 28 17:50:52.793675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 236/476] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:52 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:53.505567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:53.506451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:53.515601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:53.516208 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:53.517291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:53.517917 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:53.673602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:53.683463 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:53.684998 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:53.686167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bca60c16-e69f-47f8-af5d-ee63273bcdcb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.186181 Jun 28 17:50:53.686720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 241/477] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:53 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:53.811038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:53.811785 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:53.818990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:53.819565 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:53.820629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:53.820908 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:53.962187 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:53.970580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8d5175a0-dc5c-4a0f-8328-e7425020395e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.163434 Jun 28 17:50:53.971159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 237/478] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:53 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:54.705382 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:54.706003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:54.713157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:54.713614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:54.714426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:54.714866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:54.874639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:54.883697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:54.885314 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:54.886424 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-504da0a7-696c-4dc9-9edf-886293773c80 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.185062 Jun 28 17:50:54.887229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 242/479] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:54 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:54.987430 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:54.987982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:54.995355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:54.995794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:54.996635 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:54.997079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:55.141551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:55.152370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f2554053-a80f-4716-920b-9b130e9be61d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.168655 Jun 28 17:50:55.152987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 238/480] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:54 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:55.183620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-dec56ec6-5823-448b-89ac-a047354ba965 req-06dd60e0-9269-4853-ba38-87801e5385f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "name": "network-vif-unplugged", "status": "completed", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:55.193261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-dec56ec6-5823-448b-89ac-a047354ba965 req-06dd60e0-9269-4853-ba38-87801e5385f3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:55.193767 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-dec56ec6-5823-448b-89ac-a047354ba965 req-06dd60e0-9269-4853-ba38-87801e5385f3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:55.206481 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-dec56ec6-5823-448b-89ac-a047354ba965 req-06dd60e0-9269-4853-ba38-87801e5385f3 service nova] Creating event network-vif-unplugged:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:50:55.219990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-dec56ec6-5823-448b-89ac-a047354ba965 req-06dd60e0-9269-4853-ba38-87801e5385f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040189 Jun 28 17:50:55.221265 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 243/481] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:50:55.905615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:55.906231 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:55.913416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:55.913880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:55.915869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:55.916276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:56.084237 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:56.093012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:56.094511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:56.095705 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0b02b7a1-810c-455a-9924-40a3c33fa3da tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1719 microversion: 2.20 time: 0.194055 Jun 28 17:50:56.096256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 239/482] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:55 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:56.171303 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:56.172094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:56.175145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=66 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:56.182360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:56.183067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:56.183558 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:56.183979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:56.326561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:56.334626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bebdb261-c68d-4dfa-aeb5-6ae6da03dec6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.168164 Jun 28 17:50:56.335092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 244/483] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:56 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:57.114017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:57.114637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:57.132321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.132989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.134029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.134695 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.288990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:57.306148 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:57.307921 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:57.309192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-674c7ebd-db29-49c6-9a7a-ade1d9a73bd1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1662 microversion: 2.20 time: 0.199219 Jun 28 17:50:57.310154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 240/484] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:57 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:57.331115 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88d1568a-dde5-4a97-862b-e1cde5c24cc4"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:57.332710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:57.342080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.342527 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.343312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.343737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.354474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:57.355649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:57.365107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.365899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.367475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.367475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.539058 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:57.550829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ed81dac3-e98c-4dee-9d88-4519e786a496 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.202596 Jun 28 17:50:57.551535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 241/485] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:57 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:57.689490 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-82bff655-64cf-4981-970e-997a55616b4d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.363010 Jun 28 17:50:57.690494 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 245/486] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Jun 28 17:50:57 2022] POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:50:57.813102 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:50:57.813722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:57.815701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=66 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:57.821317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.821756 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.822550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.822971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.926424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4acff9fc-4d41-43c0-bf52-582500240a9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.117624 Jun 28 17:50:57.927035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 242/487] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 28 17:50:57 2022] POST /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:50:57.937927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:57.938421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:57.945701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.946157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:57.946955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:57.947390 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:58.114345 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:58.124524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:58.126017 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:58.127301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e10790f6-8d90-4f55-a7f2-af53b656fd10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1748 microversion: 2.20 time: 0.194323 Jun 28 17:50:58.127869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 246/488] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:57 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1748 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:58.569869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:58.570515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:58.580701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:58.581253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:58.582149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:58.583612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:58.736497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:58.745344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-33412e6b-3805-420e-a15c-0d6d85d53e1b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.179658 Jun 28 17:50:58.755173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 243/489] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:58 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:50:59.149274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:59.149861 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:59.159161 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:59.159761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:59.160703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:59.161136 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:59.305592 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:59.315018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:59.316511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:59.317670 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-32fd4ee9-09b8-4ee9-8de5-d4b3d2368a32 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1748 microversion: 2.20 time: 0.174563 Jun 28 17:50:59.318223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 247/490] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:50:59 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1748 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:50:59.763097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:50:59.763714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:50:59.775023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:59.775648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:59.777025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:50:59.777466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:50:59.915566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:50:59.925992 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7865cb35-e131-45d9-8ce4-7dd2ae25a31b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.166660 Jun 28 17:50:59.926318 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 244/491] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:50:59 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:00.341390 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:00.341982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:00.348947 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:00.349376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:00.350150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:00.350583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:00.496296 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:00.506475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:00.507979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:00.509178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-77945f53-0974-46a4-b249-9b79b5cb54d1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1748 microversion: 2.20 time: 0.171898 Jun 28 17:51:00.509782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 248/492] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:00 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:00.947669 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:00.948427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:00.956402 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:00.956872 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:00.957656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:00.958094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:01.118528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:01.127879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8a3aca71-f853-47dd-b293-8098669a98da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.183909 Jun 28 17:51:01.128506 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 245/493] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:00 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:01.531021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:01.531583 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:01.539006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:01.539457 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:01.540231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:01.540713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:01.567713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:01.693688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:01.704412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:01.706034 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:01.707248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-75081092-5ee1-42c9-a280-3a333cc5174b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1750 microversion: 2.20 time: 0.180768 Jun 28 17:51:01.708768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 249/494] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:01 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:02.146817 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:02.147543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:02.154965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:02.155411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:02.156173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:02.156624 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:02.332081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:02.340525 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a816647f-0667-4864-9941-75c2004b4615 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.198744 Jun 28 17:51:02.341165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 246/495] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:02 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:02.731802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:02.732645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:02.740087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:02.740857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:02.741874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:02.742506 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:02.911769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:02.920830 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:02.922446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:02.923599 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-921e7ea6-e0cf-490e-9854-515625652847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1750 microversion: 2.20 time: 0.198224 Jun 28 17:51:02.924159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 250/496] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:02 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:03.358920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:03.359513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:03.367094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:03.367647 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:03.368648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:03.369191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:03.518481 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:03.527960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d4da7dcc-5682-48c2-a768-f7dc19573152 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.174071 Jun 28 17:51:03.528564 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 247/497] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:03 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:03.945102 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:03.946648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:03.961256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:03.962098 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:03.963529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:03.964340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:04.114235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:04.123457 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:04.125311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:04.126480 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-89abc9b0-c713-4a96-ba2c-da9aaedf2325 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.187284 Jun 28 17:51:04.127166 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 251/498] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:03 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:04.545407 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:04.546017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:04.559893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:04.559893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:04.559893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:04.559893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:04.641125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:04.642778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:04.653375 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:04.654496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:04.656590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:04.657439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:04.854325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lazy-loading 'services' on Instance uuid a38fe61b-9245-4e9b-88ed-5c9a003554a3 {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:51:04.988832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:04.992871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-842564a2-f26d-43c0-bf07-f5e60cc29f9d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3/os-volume_attachments/0ac73bf5-f755-43e5-b189-6244040e83e3" status: 202 len: 0 microversion: 2.1 time: 0.361303 Jun 28 17:51:04.994733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 252/499] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:51:04 2022] DELETE /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3/os-volume_attachments/0ac73bf5-f755-43e5-b189-6244040e83e3 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:51:05.004041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5379c165-ddee-46ea-88c6-dc36bbad5912 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1735 microversion: 2.1 time: 0.462469 Jun 28 17:51:05.015023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 248/500] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:04 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1735 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:05.150123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:05.151195 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:05.158973 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:05.159562 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:05.160480 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:05.161059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:05.300908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:05.311689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:05.315032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:05.316192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ec5a2c7a-1dc7-4341-8a45-8b9c6abfd0e8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.173420 Jun 28 17:51:05.317694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 253/501] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:05 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:06.023105 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.023803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.030477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.031027 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.031890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.032319 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.037418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:06.173110 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.174763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.182493 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.183201 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.184023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.184578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.194078 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.202097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ee6856d6-5ed6-44bf-9684-1aacd155e659 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1715 microversion: 2.1 time: 0.183830 Jun 28 17:51:06.202686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 249/502] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:06 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1715 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:06.215880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:51:06.318400 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a55ffd01-2f0d-481b-89f6-ceed19e5db6e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 204 len: 0 microversion: 2.1 time: 0.151707 Jun 28 17:51:06.318651 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.319018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 254/503] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:51:06 2022] DELETE /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:51:06.319172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.327473 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.328207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.328362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.328825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.329807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.330403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.335264 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.335941 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.336768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.337206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.416917 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] HTTP exception thrown: Cannot 'detach_volume' instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 while it is in vm_state rescued Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Request method failure captured: Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments/a3c16e92-c412-44af-a428-3085ae78b9d4 HTTP/1.1 Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz52F2ohNuDNMxC-uWBoBNH0ysWcOkUbK87Smi1Ju0PVZ89hIdmVzvxoR4ErOTZmyHDjxZPh9A-tuTD4va1BKFjgXj_s8g-nehsNT6wQ7AbWodU1ytU301QTtbY5OB3VYDIDNAeEz6kXgsg65NE6JikkC1jrTPo_W2zOY-2eozFkihg Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:51:06.418575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}] Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 3a8c23b156174db28359e9f93c7378c8 Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:51:06.419997 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Cannot 'detach_volume' instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 while it is in vm_state rescued Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'server_id': '01690edf-8c3b-45d7-b6f3-f4e53a333c04', 'id': 'a3c16e92-c412-44af-a428-3085ae78b9d4'} Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:51:06.421147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 while it is in vm_state rescued Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 while it is in vm_state rescued Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:06.422412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Returning 409 to user: Cannot 'detach_volume' instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 while it is in vm_state rescued {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:51:06.423374 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0470d19d-f8c7-4fdf-9915-721cd513f853 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments/a3c16e92-c412-44af-a428-3085ae78b9d4" status: 409 len: 152 microversion: 2.1 time: 0.105937 Jun 28 17:51:06.423374 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 250/504] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:51:06 2022] DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments/a3c16e92-c412-44af-a428-3085ae78b9d4 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 17:51:06.427379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.427981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.435358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.435829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.436647 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.437086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.486420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.498231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a30bd438-aa5a-44c3-b2e4-2be73bd5e713 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.174712 Jun 28 17:51:06.498826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 255/505] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:06 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:06.507936 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:06.507936 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.510991 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.511441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.512311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.512862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.609148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9227e9a5-b607-4d3d-8457-410d1c0a69d6 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/action" status: 202 len: 0 microversion: 2.1 time: 0.108197 Jun 28 17:51:06.610787 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 256/506] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:51:06 2022] POST /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:51:06.620344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:06.621388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:06.628012 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.628551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.629389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:06.629825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:06.650956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.659539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.661125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.662298 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-afa66c4d-a3ed-43a9-a278-99e4cb51ba9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.240772 Jun 28 17:51:06.662820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 251/507] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:06 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:06.778742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:06.787820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-752fd978-b74a-46d8-8688-e8a673e81339 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.172555 Jun 28 17:51:06.788348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 257/508] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:06 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:07.516477 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:07.517268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:07.525521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.526159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.527234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.527914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.673110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:07.681106 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:07.681685 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b0ea518d-e02e-4ba8-98fd-a34a5372ed08 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.169759 Jun 28 17:51:07.681796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:07.682202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 252/509] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:07 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:07.689023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.689512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.690245 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.690684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.808847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:07.809640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:07.817212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.817663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.818456 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:07.818893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:07.847450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:07.856898 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:07.858673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:07.859836 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-24e94a01-6797-4570-b0a2-d0f207b7dde6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.183012 Jun 28 17:51:07.860496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 258/510] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:07 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:07.984296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:07.993152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7c86c200-1531-4a3b-a536-494f36d4393f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.190280 Jun 28 17:51:07.994146 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 253/511] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:07 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:08.700837 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:08.702957 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:08.710937 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:08.711444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:08.712579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:08.712879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:08.878860 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:08.882448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:08.882620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:08.890148 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:08.890692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:08.891576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:08.892099 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:08.895102 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-263bf808-8ace-414f-a406-5c0dc4bb5a0e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.198918 Jun 28 17:51:08.896085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 259/512] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:08 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:09.017524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:09.018157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:09.028556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:09.029205 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:09.030164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:09.030584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:09.065295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:09.075615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:09.077152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:09.078351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bfbe7887-7b2e-43ba-9770-9049920bbc89 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.203901 Jun 28 17:51:09.087026 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 254/513] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:08 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:09.187758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:09.198614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9c713eba-3154-42a4-aea2-6d8eadda5cc4 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.190362 Jun 28 17:51:09.199290 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 260/514] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:09 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:09.923423 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:09.924229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:09.934097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:09.935001 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:09.937355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:09.938175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:10.096180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:10.097744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:10.098612 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:10.104282 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-15d68a7b-edde-4118-aa15-476e1797b92e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.185112 Jun 28 17:51:10.105465 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:10.105910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:10.106687 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:10.107315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:10.108128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 255/515] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:09 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:10.218959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:10.220341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:10.227073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:10.227539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:10.228324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:10.228810 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:10.261348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:10.271152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:10.272767 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:10.273968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-398c14bd-0081-450a-b3e3-ca26af5a967a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.180660 Jun 28 17:51:10.274532 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 261/516] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:10 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:10.374868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:10.385152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-09bc3da4-0666-464f-a4a7-68dbc205571d tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.170249 Jun 28 17:51:10.386317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 256/517] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:10 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:11.122922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:11.123569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:11.132075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.132557 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.133372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.133845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.286480 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:11.290791 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:11.293555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:11.294594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:11.296859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d254d2d2-c0de-4962-a436-3567b3970a64 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.178756 Jun 28 17:51:11.297581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 262/518] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:11 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:11.302047 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.302500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.303971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.303971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.403105 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:11.403743 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:11.411714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.412170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.413048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:11.413495 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:11.464833 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:11.484699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:11.486621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:11.487929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-858f500e-c213-4299-9d03-a432ef46fb68 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.199342 Jun 28 17:51:11.488749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 257/519] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:11 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:11.567024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:11.575704 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d86e49b6-76c6-4013-b30e-5683e2aa1feb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.176394 Jun 28 17:51:11.576561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 263/520] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:11 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:12.316198 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:12.316871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:12.323784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.324225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.325023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.325470 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.462792 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:12.470895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-377c9922-9c67-405d-9cb7-f11e8809823c tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.158710 Jun 28 17:51:12.471722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 258/521] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:12 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:12.506498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:12.507271 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:12.514047 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.514509 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.515383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.515905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.596666 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:12.597421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:12.604174 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.604921 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.605698 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.606140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.712834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:12.722214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:12.723988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:12.725443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e10b309f-6e71-417e-9af5-34da9ab4bf64 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.223039 Jun 28 17:51:12.726094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 264/522] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:12 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:12.764953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:12.767549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1790006430"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:12.768274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:12.775017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e96f159f-03bd-43b8-bd30-a1155e7c5ad8 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.184219 Jun 28 17:51:12.775601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 259/523] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:12 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:12.776842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.777308 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.778091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:12.778535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:12.922641 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.network.security_group_api [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Removing security group 67db749b-4638-4ac4-82dc-b93923022177 from port 6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 Jun 28 17:51:13.356367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c4d90be1-944d-42db-aac0-908b9e187391 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action" status: 202 len: 0 microversion: 2.1 time: 0.594081 Jun 28 17:51:13.361521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 265/524] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:51:12 2022] POST /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:51:13.376284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-0a867c95-245c-4dbf-9310-045d4b3dd144 req-1d8c3805-d6ed-4165-9dfe-b2d3175ad9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:13.391772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-0a867c95-245c-4dbf-9310-045d4b3dd144 req-1d8c3805-d6ed-4165-9dfe-b2d3175ad9bd service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.392766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-0a867c95-245c-4dbf-9310-045d4b3dd144 req-1d8c3805-d6ed-4165-9dfe-b2d3175ad9bd service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.458295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-0a867c95-245c-4dbf-9310-045d4b3dd144 req-1d8c3805-d6ed-4165-9dfe-b2d3175ad9bd service nova] Creating event network-changed:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:51:13.472726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-0a867c95-245c-4dbf-9310-045d4b3dd144 req-1d8c3805-d6ed-4165-9dfe-b2d3175ad9bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095362 Jun 28 17:51:13.474143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 260/525] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:13.488789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:13.489668 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:13.504997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.505757 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.506750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.508025 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.746610 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:13.747512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:13.766583 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.767501 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.768455 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.778122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.808540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:13.818180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bd4eec6f-be77-4944-975c-6d837a3b2de9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.334250 Jun 28 17:51:13.821069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 266/526] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:13 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:13.842682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:13.844193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:13.858684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.861777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:13.862851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:13.863442 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:14.155969 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:14.172349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f1517ef9-3387-404b-8ab0-39503ba54ec1 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.349621 Jun 28 17:51:14.174333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 267/527] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:13 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:14.262089 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:14.273571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:14.275403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:14.276680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-32e459ab-6265-43ae-a391-77d3d5f46f42 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.535215 Jun 28 17:51:14.277726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 261/528] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:13 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:14.839586 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:14.841167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:14.850293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:14.851042 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:14.851995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:14.852630 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.019400 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:15.050163 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:15.050795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2a7fde64-8245-4c5f-b2fb-52d4dd27e8b4 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.214831 Jun 28 17:51:15.050902 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:15.053203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 268/529] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:14 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:15.063391 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.066362 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-198d1325-101d-44bf-942a-c1f6033bcf20 req-5c116712-760b-4b8e-aa0f-5ddb51cf049f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:15.067377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.068465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.072733 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.095839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-198d1325-101d-44bf-942a-c1f6033bcf20 req-5c116712-760b-4b8e-aa0f-5ddb51cf049f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.096848 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-198d1325-101d-44bf-942a-c1f6033bcf20 req-5c116712-760b-4b8e-aa0f-5ddb51cf049f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.115643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-198d1325-101d-44bf-942a-c1f6033bcf20 req-5c116712-760b-4b8e-aa0f-5ddb51cf049f service nova] Creating event network-changed:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:51:15.136546 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-198d1325-101d-44bf-942a-c1f6033bcf20 req-5c116712-760b-4b8e-aa0f-5ddb51cf049f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076145 Jun 28 17:51:15.137504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 269/530] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:15.194085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:15.195189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:15.207015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.207646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.209569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.210147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.238196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lazy-loading 'services' on Instance uuid 52a855b5-4644-4ff3-8474-89e2d5c0af8f {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:51:15.387959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-50fc240e-b779-4a2b-9d12-f7778dd28900 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments/6163402b-f9e9-4896-b8d6-2b6e794ded92" status: 202 len: 0 microversion: 2.1 time: 0.347099 Jun 28 17:51:15.389322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 262/531] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:51:15 2022] DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments/6163402b-f9e9-4896-b8d6-2b6e794ded92 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:51:15.415246 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:15.415959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:15.423193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.424209 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:15.433779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.434633 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.435553 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.439646 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-106c7fba-d745-4bbb-9d04-520f1555bd21 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.251511 Jun 28 17:51:15.440875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 270/532] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:15 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:15.447648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:15.449258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:15.459326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.460143 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.461186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:15.461793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:15.503430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7e3ba11e-49c5-4c9e-80d1-0f944af7b8f2 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061145 Jun 28 17:51:15.505419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 271/533] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:15 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:15.646035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:15.665261 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:15.666802 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:15.667948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ea94e7ef-a3d5-46c7-b1bb-acc47ac6ff21 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.277380 Jun 28 17:51:15.668725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 263/534] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:15 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:16.070923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:16.071623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:16.080102 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.080665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.081850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.082356 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.282403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:16.299269 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-36f280c9-721d-4254-9aa1-81cef3814ccd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.232123 Jun 28 17:51:16.300272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 272/535] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:16 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:16.460370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:16.462134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:16.469816 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.470276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.471064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.471500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.520081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:16.521898 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:16.530972 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.531418 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.532198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.532670 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.564472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f768a5de-f1d7-4db1-92fa-68a01ad2ec82 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052299 Jun 28 17:51:16.565075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 273/536] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:16 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:16.621400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:16.630578 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2e77dc17-b6c8-4811-a9d6-bb1ae26bb75a tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.175275 Jun 28 17:51:16.631154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 264/537] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:16 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:16.687610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:16.688221 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:16.694743 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.695192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.695976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:16.696428 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:16.839819 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:16.850010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:16.851553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:16.852768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d5f1efcc-4e05-47d5-9268-91a5ef6a1457 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.169303 Jun 28 17:51:16.853317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 274/538] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:16 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:17.317561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:17.318064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:17.324935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.325414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.326179 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.327309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.499218 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:17.503037 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:17.508524 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7683aea8-1172-44c7-af9d-4b937ffbd6b5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.195162 Jun 28 17:51:17.509118 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 265/539] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:17 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:17.577310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:17.578253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:17.585471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.585931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.586737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.587221 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.624071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-232bfb24-5458-4f70-b231-e45722538148 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051592 Jun 28 17:51:17.624695 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 275/540] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:17 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:17.649380 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:17.649986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:17.659838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.660459 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.661485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.662128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.808831 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:17.818810 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e2f4e761-dfd4-4713-8968-ba991814123f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.173280 Jun 28 17:51:17.819407 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 266/541] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:17 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:17.871382 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:17.871929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:17.884840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.885308 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:17.886108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:17.886531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.026761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:18.036679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:18.038170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:18.039324 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ae38a0ec-076f-42af-9297-2c29481d5207 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.171994 Jun 28 17:51:18.039875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 276/542] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:17 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:18.526533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:18.527203 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:18.536142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.537265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.538302 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.540140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.637391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:18.638313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:18.646128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.646883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.647619 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.648208 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.683826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7a281ce9-9fb5-49fc-af49-54e60e3458cb tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050400 Jun 28 17:51:18.684746 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 277/543] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:18 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:51:18.765568 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:18.779743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c06ffb71-16fd-4fbb-960a-83f12b779877 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1512 microversion: 2.1 time: 0.256911 Jun 28 17:51:18.790664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 267/544] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:18 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:18.841317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:18.842419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:18.853370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.854985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:18.855988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:18.857467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.057737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:19.058358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:19.072891 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.073801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.074804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.075815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.210717 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:19.221603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9a75810e-30a4-4ac1-8bde-32a9e94361cd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.386027 Jun 28 17:51:19.222839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 278/545] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:18 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:19.229404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-7fe39ee1-1bbd-47a4-afcf-2fb97756a1a8 req-8aa52ce5-9fe2-4eb4-83db-46b82b9f47b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38fe61b-9245-4e9b-88ed-5c9a003554a3", "name": "network-vif-deleted", "tag": "d9afef26-579a-4cbf-a21c-4278e1c0f348"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:19.242552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-7fe39ee1-1bbd-47a4-afcf-2fb97756a1a8 req-8aa52ce5-9fe2-4eb4-83db-46b82b9f47b9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.243511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-7fe39ee1-1bbd-47a4-afcf-2fb97756a1a8 req-8aa52ce5-9fe2-4eb4-83db-46b82b9f47b9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.279704 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-7fe39ee1-1bbd-47a4-afcf-2fb97756a1a8 req-8aa52ce5-9fe2-4eb4-83db-46b82b9f47b9 service nova] Creating event network-vif-deleted:d9afef26-579a-4cbf-a21c-4278e1c0f348 for instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 on hv-cinder-84801 Jun 28 17:51:19.285933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-7fe39ee1-1bbd-47a4-afcf-2fb97756a1a8 req-8aa52ce5-9fe2-4eb4-83db-46b82b9f47b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061210 Jun 28 17:51:19.286598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 279/546] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:19.323303 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:19.333447 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:19.335198 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:19.336481 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5fd44fdc-6958-420a-9117-5a517c198f70 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.282741 Jun 28 17:51:19.340368 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 268/547] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:19 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:19.698134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:19.699118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:19.706397 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.707693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.708985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.709514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.743333 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d9fad85e-fef8-40b2-8e80-8e6680072914 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050130 Jun 28 17:51:19.743929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 280/548] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:19 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:51:19.758636 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:19.759249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:19.766155 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.766596 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.767372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.767802 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.798016 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:19.798643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:19.805490 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.805949 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.806989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.807611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.814847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=100 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:19.842640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:19.843091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:19.843521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lazy-loading 'fault' on Instance uuid a38fe61b-9245-4e9b-88ed-5c9a003554a3 {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:51:20.028289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] HTTP exception thrown: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f is not attached to volume 6163402b-f9e9-4896-b8d6-2b6e794ded92 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Request method failure captured: Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments/6163402b-f9e9-4896-b8d6-2b6e794ded92 HTTP/1.1 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz7HptltrC62K8mzKBvExXXcZ6Xk5EG57Hv7E_qpKtP4ltXbRYdRp59YzEdRpJr2z0zpESvYGFLXOQiVoQn3rxHdwMVsIYgcVNGURj4nf9ECKcldfmfG1tC9oD_lb_QxrN7ZR85IR9p5_pKxiEt621AmqZejh2B9CmRL2KmSCNu4NzU Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 63b5557298f24f0bb26ce631568ef4f4 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:51:20.034834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b5557298f24f0bb26ce631568ef4f4"}]}] Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 63b5557298f24f0bb26ce631568ef4f4 Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-TestMinimumBasicScenario-838969898-project Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: b34f604dcc0a4639884bb925cabfd535 Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-TestMinimumBasicScenario-838969898-project Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:51:20.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f is not attached to volume 6163402b-f9e9-4896-b8d6-2b6e794ded92 Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'server_id': '52a855b5-4644-4ff3-8474-89e2d5c0af8f', 'id': '6163402b-f9e9-4896-b8d6-2b6e794ded92'} Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6163402b-f9e9-4896-b8d6-2b6e794ded92. Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:51:20.037452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f is not attached to volume 6163402b-f9e9-4896-b8d6-2b6e794ded92 Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f is not attached to volume 6163402b-f9e9-4896-b8d6-2b6e794ded92 Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:20.039088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Returning 404 to user: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f is not attached to volume 6163402b-f9e9-4896-b8d6-2b6e794ded92 {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:51:20.040491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b37a94de-99ab-4a34-ba2e-ad1849d924fd tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments/6163402b-f9e9-4896-b8d6-2b6e794ded92" status: 404 len: 154 microversion: 2.1 time: 0.286233 Jun 28 17:51:20.040735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 269/549] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:51:19 2022] DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f/os-volume_attachments/6163402b-f9e9-4896-b8d6-2b6e794ded92 => generated 154 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:51:20.059575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:20.067910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fe1a5f1b-2669-4680-8635-fad767937572 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1308 microversion: 2.1 time: 0.274057 Jun 28 17:51:20.068756 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 281/550] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:19 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:20.238935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:20.239489 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:20.247807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:20.248503 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:20.249309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:20.249774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:20.355374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:20.355950 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:20.362602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:20.363407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:20.364263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:20.364840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:20.399771 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:20.408954 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1dbf04df-5fc9-4209-8b89-9324c1c13203 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.174038 Jun 28 17:51:20.409874 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 270/551] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:20 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:20.510882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:20.520540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:20.522049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:20.523197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-99388157-8b6b-4a69-96a1-be33e8ccda27 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.171875 Jun 28 17:51:20.523750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 282/552] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:20 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:21.085877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:21.086490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:21.094229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.094607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.095390 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.095817 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.136906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.137257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.137711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lazy-loading 'fault' on Instance uuid a38fe61b-9245-4e9b-88ed-5c9a003554a3 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:51:21.184135 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:21.184721 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:21.185605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.191479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.191920 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.192727 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.193158 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.195221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b74873ac-c537-421c-8957-7062a0b91510 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 200 len: 1308 microversion: 2.1 time: 0.113422 Jun 28 17:51:21.195878 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 271/553] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:21 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:21.220953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:51:21.312457 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4f2cfff2-fc53-4017-bd67-ef99aa7b602f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 204 len: 0 microversion: 2.1 time: 0.132758 Jun 28 17:51:21.313053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 283/554] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:51:21 2022] DELETE /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:51:21.322068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:21.322297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:21.328655 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.329046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.329818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.330250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.429128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:21.429371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:21.436083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.437247 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.438024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.438456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.535291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.543542 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9018066f-249d-4401-becf-beca6243e431 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1556 microversion: 2.1 time: 0.225803 Jun 28 17:51:21.544110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 272/555] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:21 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:21.549073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:21.549679 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:21.556181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.556664 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.557736 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:21.558152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:21.601944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.611004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fb5bde52-6f29-4e62-b586-f98885a3af00 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1723 microversion: 2.1 time: 0.186871 Jun 28 17:51:21.611576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 284/556] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:21 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:21.696151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.705269 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.706761 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:21.707923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c619faca-d2ba-40ce-b6dc-c6b9ff200b08 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.163050 Jun 28 17:51:21.708467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 273/557] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:21 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:22.213774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:22.214421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: a38fe61b-9245-4e9b-88ed-5c9a003554a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:22.221541 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.222774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.223563 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.224371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.240466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] HTTP exception thrown: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Request method failure captured: Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 HTTP/1.1 Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz9JG-oGgmeLMFZyk5N3fCRsXSa0483_dLaP8ahBpsaN5U1eApspqOLLr7JcErcjRHEEXXp0Poe_BB20l92PNc-odQ-99f8ebEPgo-6brywn2zBQrvvovuimMN8CjvNVrYDtBx9FMMSqRwXCIgOopbN2bW5eWG8_Z2BTdDC29CxIPlc Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: d8293e6549634daab6d74028a64442db Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:51:22.242377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8293e6549634daab6d74028a64442db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8293e6549634daab6d74028a64442db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8293e6549634daab6d74028a64442db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8293e6549634daab6d74028a64442db"}]}] Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: d8293e6549634daab6d74028a64442db Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesSnapshotTestJSON-772461016-project Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 5b2c082e20fe4ab2a739d8e671816e63 Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesSnapshotTestJSON-772461016-project Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. Jun 28 17:51:22.243890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'a38fe61b-9245-4e9b-88ed-5c9a003554a3'} Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:51:22.244771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. Jun 28 17:51:22.246129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:22.248067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Returning 404 to user: Instance a38fe61b-9245-4e9b-88ed-5c9a003554a3 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:51:22.248067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9c3d1697-b0a7-4221-a8a4-202f548e8891 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3" status: 404 len: 111 microversion: 2.1 time: 0.034064 Jun 28 17:51:22.248067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 285/558] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:22 2022] GET /compute/v2.1/servers/a38fe61b-9245-4e9b-88ed-5c9a003554a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:51:22.563920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:22.564607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:22.574164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.574835 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.575976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.576617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.629594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:22.630448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:22.636850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.637299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.638068 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.638503 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.718422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:22.726777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c5bc6485-6d93-45c1-be07-049dcb59f4ff tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1556 microversion: 2.1 time: 0.167805 Jun 28 17:51:22.727454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 274/559] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:22 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:22.734766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:22.734766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:22.739304 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.739751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.740538 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.740967 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.783180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:22.791693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-26800723-83e0-4b3b-b3e2-488a54ece395 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1729 microversion: 2.1 time: 0.166494 Jun 28 17:51:22.792520 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 286/560] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:22 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:22.810284 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:22.810841 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:22.816006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:22.827682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.828172 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.829154 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:22.829575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:22.902634 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:22.911752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:22.913356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:22.914650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7b045b99-e5e7-4a9c-890b-70b7d95d4335 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.186162 Jun 28 17:51:22.915670 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 275/561] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:22 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:22.928191 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-991abe14-843a-43e3-a4d7-fc1663515400 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121603 Jun 28 17:51:22.929299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 287/562] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:51:22 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:51:23.743523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:23.744137 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:23.752485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:23.752994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:23.753780 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:23.754207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:23.934676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:23.935301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:23.941922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:23.942371 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:23.943163 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:23.943601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:23.972207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:23.981624 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-45aeb027-0037-464a-a2e7-896c8596d15e tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1556 microversion: 2.1 time: 0.242070 Jun 28 17:51:23.982549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 276/563] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:23 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:24.085644 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:24.094983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:24.096553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:24.097813 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8f6ae13f-20ff-474d-a115-ace305433807 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.168039 Jun 28 17:51:24.098390 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 288/564] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:23 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:24.263935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-b01488ad-b6ab-4b51-9617-75ea0c83eb4d req-71751916-b83d-4bb8-bd65-c28098033e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:24.274625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-b01488ad-b6ab-4b51-9617-75ea0c83eb4d req-71751916-b83d-4bb8-bd65-c28098033e72 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:24.275055 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-b01488ad-b6ab-4b51-9617-75ea0c83eb4d req-71751916-b83d-4bb8-bd65-c28098033e72 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:24.292896 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-b01488ad-b6ab-4b51-9617-75ea0c83eb4d req-71751916-b83d-4bb8-bd65-c28098033e72 service nova] Creating event network-changed:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:51:24.300262 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-b01488ad-b6ab-4b51-9617-75ea0c83eb4d req-71751916-b83d-4bb8-bd65-c28098033e72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042610 Jun 28 17:51:24.301144 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 277/565] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:25.000097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:25.000747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:25.008170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:25.008639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:25.009432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:25.009862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:25.116661 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:25.117790 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:25.128012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:25.129193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:25.130754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:25.131506 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:25.205807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:25.221910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6f0eb2b2-7bf1-4114-b468-1348abac8de8 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1556 microversion: 2.1 time: 0.225322 Jun 28 17:51:25.223446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 289/566] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:24 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:25.337567 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:25.347421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:25.349799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:25.351022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1ac91ba4-c46b-47bc-9b99-fd34998fead1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.239001 Jun 28 17:51:25.351777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 278/567] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:25 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:26.239725 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:26.240325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:26.247733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:26.248334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:26.249889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:26.250334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:26.323069 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-a8aba7a7-4d3a-420b-b206-836ce56729ab req-5c24c979-64ef-4a89-acf0-a4e1a9acab3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:26.333242 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-a8aba7a7-4d3a-420b-b206-836ce56729ab req-5c24c979-64ef-4a89-acf0-a4e1a9acab3a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:26.333689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-a8aba7a7-4d3a-420b-b206-836ce56729ab req-5c24c979-64ef-4a89-acf0-a4e1a9acab3a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:26.349783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-a8aba7a7-4d3a-420b-b206-836ce56729ab req-5c24c979-64ef-4a89-acf0-a4e1a9acab3a service nova] Creating event network-changed:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:51:26.355502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-a8aba7a7-4d3a-420b-b206-836ce56729ab req-5c24c979-64ef-4a89-acf0-a4e1a9acab3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040399 Jun 28 17:51:26.356121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 279/568] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:51:26.371073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:26.371778 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:26.380452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:26.380910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:26.381793 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:26.382158 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:26.409024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:26.416594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7ed2a16d-3b58-468d-a130-7c4549ab8496 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1556 microversion: 2.1 time: 0.180881 Jun 28 17:51:26.417169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 290/569] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:26 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:26.543750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:26.556808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:26.558508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:26.559949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f16882be-971b-43af-8c5c-cb5124ae6cf6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.193408 Jun 28 17:51:26.560711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 280/570] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:26 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:27.425880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 17:51:27.426409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 17:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 17:51:27.434148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:27.434874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:27.447325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:27.447761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:27.448595 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:27.449015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:27.525080 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-ce10783b-580c-42a5-933a-f4910569f265 req-a9c4959b-c5e8-4e22-a861-737e87e46e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a855b5-4644-4ff3-8474-89e2d5c0af8f", "name": "network-vif-deleted", "tag": "6cfdbc15-3376-46e7-8ea4-dc6eefc06de0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:27.534627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ce10783b-580c-42a5-933a-f4910569f265 req-a9c4959b-c5e8-4e22-a861-737e87e46e86 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:27.535086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ce10783b-580c-42a5-933a-f4910569f265 req-a9c4959b-c5e8-4e22-a861-737e87e46e86 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:27.540207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:27.547853 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-ce10783b-580c-42a5-933a-f4910569f265 req-a9c4959b-c5e8-4e22-a861-737e87e46e86 service nova] Creating event network-vif-deleted:6cfdbc15-3376-46e7-8ea4-dc6eefc06de0 for instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f on hv-cinder-84801 Jun 28 17:51:27.548522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bb69fcb6-d621-484d-920b-dcc166b8c53f tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1514 microversion: 2.1 time: 0.118248 Jun 28 17:51:27.549459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 291/571] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:27 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1514 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:27.554271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-ce10783b-580c-42a5-933a-f4910569f265 req-a9c4959b-c5e8-4e22-a861-737e87e46e86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 Jun 28 17:51:27.554928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 281/572] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:51:27.578519 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:27.579131 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:27.585857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:27.586354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:27.587167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:27.587645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:27.734937 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:27.747959 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:27.749689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:27.750904 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fb153e18-1f96-4712-8bd5-aa1e6853678a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.176645 Jun 28 17:51:27.751679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 292/573] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:27 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:28.570636 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:28.571840 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:28.576264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=84 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:28.586731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:28.587575 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:28.588975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:28.589674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:28.663513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:28.677186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-563c5e9f-24ad-47de-a021-c7a01f517e7d tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1514 microversion: 2.1 time: 0.113860 Jun 28 17:51:28.677855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 282/574] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:28 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1514 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:28.773948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:28.774644 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:28.785871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:28.786422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:28.787311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:28.787814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:28.976847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:28.991536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:28.993703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:28.995403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bdcd02a2-3d82-423b-9003-0814e325b56d tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.227616 Jun 28 17:51:28.996221 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 293/575] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:28 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:29.696289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:29.696942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:29.704290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:29.704769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:29.705537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:29.705963 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:29.782754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34f604dcc0a4639884bb925cabfd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b5557298f24f0bb26ce631568ef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:29.792460 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cf886323-2b66-4cad-982f-4b4b0f062866 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 200 len: 1514 microversion: 2.1 time: 0.100533 Jun 28 17:51:29.793059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 283/576] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:29 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 1514 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:30.017769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:30.021403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:30.029648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.030904 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.031958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.032679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.247731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1213083765", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "networks": [{"uuid": "9c0c055e-3a8e-49d7-929a-475900bc6fda"}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:30.264040 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:30.275380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:30.280155 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:30.281596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-36374f80-5e82-4385-b647-11fa47dbb292 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.269296 Jun 28 17:51:30.282318 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 294/577] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:30 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:30.315373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] validate_networks() for [('9c0c055e-3a8e-49d7-929a-475900bc6fda', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:51:30.810758 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:51:30.811884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:30.812154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:51:30.812468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] [instance: 52a855b5-4644-4ff3-8474-89e2d5c0af8f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:30.813418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:51:30.813896 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:51:30.814403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:51:30.821170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.821637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.822600 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.823214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.830928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.831591 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.832612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:30.833415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:30.839166 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] HTTP exception thrown: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Request method failure captured: Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f HTTP/1.1 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz7HptltrC62K8mzKBvExXXcZ6Xk5EG57Hv7E_qpKtP4ltXbRYdRp59YzEdRpJr2z0zpESvYGFLXOQiVoQn3rxHdwMVsIYgcVNGURj4nf9ECKcldfmfG1tC9oD_lb_QxrN7ZR85IR9p5_pKxiEt621AmqZejh2B9CmRL2KmSCNu4NzU Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 63b5557298f24f0bb26ce631568ef4f4 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:51:30.840804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63b5557298f24f0bb26ce631568ef4f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b5557298f24f0bb26ce631568ef4f4"}]}] Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 63b5557298f24f0bb26ce631568ef4f4 Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-TestMinimumBasicScenario-838969898 Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-TestMinimumBasicScenario-838969898-project Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: b34f604dcc0a4639884bb925cabfd535 Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-TestMinimumBasicScenario-838969898-project Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. Jun 28 17:51:30.842651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '52a855b5-4644-4ff3-8474-89e2d5c0af8f'} Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:51:30.843988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. Jun 28 17:51:30.845538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:51:30.846894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Returning 404 to user: Instance 52a855b5-4644-4ff3-8474-89e2d5c0af8f could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:51:30.846894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3ef5683e-fa0e-4700-95d6-cc76ee141ef1 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f" status: 404 len: 111 microversion: 2.1 time: 0.034930 Jun 28 17:51:30.846894 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 295/578] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:30 2022] GET /compute/v2.1/servers/52a855b5-4644-4ff3-8474-89e2d5c0af8f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:51:30.847197 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:30.852409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3246b7fc-e1a7-4d55-8776-5834657a3114 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] Calling method '.version_select at 0x7f5771f57040>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:30.865745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Getting quotas for project d8293e6549634daab6d74028a64442db. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:51:30.870689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Getting quotas for user 5b2c082e20fe4ab2a739d8e671816e63 and project d8293e6549634daab6d74028a64442db. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:51:30.883248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3246b7fc-e1a7-4d55-8776-5834657a3114 tempest-TestMinimumBasicScenario-838969898 tempest-TestMinimumBasicScenario-838969898-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1762742589" status: 202 len: 0 microversion: 2.1 time: 0.034678 Jun 28 17:51:30.883877 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 296/579] 10.222.0.43 () {58 vars in 1271 bytes} [Tue Jun 28 17:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1762742589 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:51:30.886151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:51:30.888492 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:51:30.946329 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ae261494-cea2-430f-9427-0a113d714e7d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709618 Jun 28 17:51:30.947165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 284/580] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:51:30.957532 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-30547fd7-99a4-43d0-969d-9c2414ea8214 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:30.958170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-30547fd7-99a4-43d0-969d-9c2414ea8214 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:31.041337 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-30547fd7-99a4-43d0-969d-9c2414ea8214 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:31.048851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-30547fd7-99a4-43d0-969d-9c2414ea8214 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1219 microversion: 2.1 time: 0.095110 Jun 28 17:51:31.049442 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 297/581] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:30 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:31.300276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:31.301169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:31.307733 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:31.308453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:31.309408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:31.309995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:31.459101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:31.478490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:31.480015 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:31.481414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e56b2f51-4dca-4f09-8f72-f958c0cfecd8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.185914 Jun 28 17:51:31.484162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 285/582] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:31 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:32.067174 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-327f4184-a71b-4475-a34e-deeeea347ad2 req-58f9bc3c-ff87-4c01-b98d-c1a550224a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "name": "network-vif-plugged", "status": "completed", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:32.067837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:32.068178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:32.074675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:32.075161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:32.075934 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:32.076370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:32.078052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-327f4184-a71b-4475-a34e-deeeea347ad2 req-58f9bc3c-ff87-4c01-b98d-c1a550224a98 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:32.078518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-327f4184-a71b-4475-a34e-deeeea347ad2 req-58f9bc3c-ff87-4c01-b98d-c1a550224a98 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:32.107113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-327f4184-a71b-4475-a34e-deeeea347ad2 req-58f9bc3c-ff87-4c01-b98d-c1a550224a98 service nova] Creating event network-vif-plugged:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:51:32.116208 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-327f4184-a71b-4475-a34e-deeeea347ad2 req-58f9bc3c-ff87-4c01-b98d-c1a550224a98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052970 Jun 28 17:51:32.117633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 298/583] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:32.169046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:32.185428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-27422863-04b8-4fd2-af5a-f322ddd8c3cd tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1271 microversion: 2.1 time: 0.122583 Jun 28 17:51:32.187226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 286/584] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:32 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:32.500283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:32.501009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:32.510450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:32.510923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:32.511704 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:32.512145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:32.744227 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:32.754276 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:32.756721 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:32.758212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7b624d42-e6bc-4262-859c-de1fce14f73f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.262591 Jun 28 17:51:32.760027 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 299/585] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:32 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:33.204215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:33.204857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:33.211954 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:33.212799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:33.213603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:33.214204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:33.314531 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:33.327766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5b0063e4-a85f-4a00-8872-b4641e18afd9 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1277 microversion: 2.1 time: 0.128022 Jun 28 17:51:33.328843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 287/586] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:33 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:33.778705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:33.780356 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:33.788279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:33.789253 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:33.790312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:33.790988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:33.796359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:34.109169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:34.118720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:34.120723 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:34.122309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d6f80595-095e-46d5-8b03-5f54de9cb20b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.347732 Jun 28 17:51:34.133650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 300/587] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:33 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:51:34.349007 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:34.350132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:34.379484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:34.379990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:34.380937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:34.381606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:34.774490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:34.786984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-531438d2-0de0-4fb8-ab55-599d17df273e tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.444327 Jun 28 17:51:34.797234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 288/588] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:34 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:35.082327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-ea1a19ea-9b58-43cc-8e3a-7ef714c6a694 req-21b36707-dc56-4c0c-b22e-ec93f515f87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d379ed5-48f0-4771-b202-40633054d1ed", "tag": "e924df90-c8b0-4049-8bc2-65baad7e1b58"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:35.101685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-ea1a19ea-9b58-43cc-8e3a-7ef714c6a694 req-21b36707-dc56-4c0c-b22e-ec93f515f87d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:35.102581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-ea1a19ea-9b58-43cc-8e3a-7ef714c6a694 req-21b36707-dc56-4c0c-b22e-ec93f515f87d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:35.116280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-ea1a19ea-9b58-43cc-8e3a-7ef714c6a694 req-21b36707-dc56-4c0c-b22e-ec93f515f87d service nova] Creating event network-changed:e924df90-c8b0-4049-8bc2-65baad7e1b58 for instance 6d379ed5-48f0-4771-b202-40633054d1ed on hv-cinder-84801 Jun 28 17:51:35.127758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-ea1a19ea-9b58-43cc-8e3a-7ef714c6a694 req-21b36707-dc56-4c0c-b22e-ec93f515f87d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050815 Jun 28 17:51:35.129187 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 301/589] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:35.146010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:35.147628 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:35.167818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:35.168983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:35.170839 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:35.172036 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:35.514606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:35.526618 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:35.528522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:35.530400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2b859899-0619-4711-8fe6-a728905ccae4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1806 microversion: 2.20 time: 0.392418 Jun 28 17:51:35.531388 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 289/590] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:35 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1806 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:35.812169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:35.813308 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:35.822884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:35.823601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:35.824634 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:35.825297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:36.071419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:36.086500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7cce8c7f-024c-4706-847d-b118617e0dab tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.278392 Jun 28 17:51:36.088409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 302/591] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:35 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:36.559983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:36.561448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:36.570631 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:36.571284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:36.573563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:36.574396 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:37.112256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:37.114039 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:37.127182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:37.128223 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:37.130071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:37.130851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:37.228609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:37.245535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:37.248433 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:37.250554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-96789e06-8d75-470e-b9fc-bc5e51d2f912 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1793 microversion: 2.20 time: 0.695718 Jun 28 17:51:37.261789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 290/592] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:51:36 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1793 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:51:37.372536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:37.381436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-361efcae-6164-4c75-887c-0ab0e62570a5 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.277583 Jun 28 17:51:37.382009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 303/593] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:37 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:51:38.399255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:38.399891 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:38.406539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:38.406982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:38.407751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:38.408176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:38.623535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:38.641620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-28107cad-f40b-4ec8-9721-7834e5a10acb tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.246203 Jun 28 17:51:38.642229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 291/594] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:38 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:38.654491 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 17:51:38.655332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 17:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 17:51:39.659619 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:39.660846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:39.668758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:39.669263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:39.670245 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:39.671003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:39.826144 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:39.836797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-85627bbb-45d0-46e2-b0b5-7b58d8f6ea89 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.181756 Jun 28 17:51:39.837658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 304/595] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:39 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:40.264207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-1932a785-74e1-4d82-9310-65fbb237b91d req-cdd33958-a3f7-4f2d-9e1f-92fbe47bdd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379ed5-48f0-4771-b202-40633054d1ed", "name": "network-vif-plugged", "status": "completed", "tag": "e924df90-c8b0-4049-8bc2-65baad7e1b58"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:40.275360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-1932a785-74e1-4d82-9310-65fbb237b91d req-cdd33958-a3f7-4f2d-9e1f-92fbe47bdd8f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:40.275796 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-1932a785-74e1-4d82-9310-65fbb237b91d req-cdd33958-a3f7-4f2d-9e1f-92fbe47bdd8f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:40.289826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-1932a785-74e1-4d82-9310-65fbb237b91d req-cdd33958-a3f7-4f2d-9e1f-92fbe47bdd8f service nova] Creating event network-vif-plugged:e924df90-c8b0-4049-8bc2-65baad7e1b58 for instance 6d379ed5-48f0-4771-b202-40633054d1ed on hv-cinder-84801 Jun 28 17:51:40.295304 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-1932a785-74e1-4d82-9310-65fbb237b91d req-cdd33958-a3f7-4f2d-9e1f-92fbe47bdd8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Jun 28 17:51:40.296375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 292/596] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:40.856629 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:40.857765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:40.866886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:40.867982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:40.868351 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:40.868831 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:41.049329 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:41.115080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:41.125773 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4be7f01e-ffed-4bf2-a03a-a16dea62d2c8 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1319 microversion: 2.1 time: 0.274545 Jun 28 17:51:41.126925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 305/597] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:40 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:42.141045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:42.141760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:42.147647 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:42.148424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:42.156333 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:42.156810 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:42.157591 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:42.158027 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:42.328326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:42.337825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a8c9dd9a-0452-4e2b-864b-037425761373 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1507 microversion: 2.1 time: 0.198118 Jun 28 17:51:42.338717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 293/598] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:42 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:42.356188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85519670-7b8e-4e4c-8828-cede3519a510", "device": "/dev/sdb"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:42.358057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:42.366139 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:42.366594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:42.367422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:42.367866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:42.697405 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7979aca7-2a71-456b-b253-cf4bad14a559 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "POST /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345123 Jun 28 17:51:42.705719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 306/599] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:51:42 2022] POST /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:51:50.250238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:50.251772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:50.259672 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.260225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.261110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.261641 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.297450 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a33b71fb-184e-4371-a751-05d6d47fe479 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052978 Jun 28 17:51:50.298606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 294/600] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:51:50 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:51:50.361156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:50.371121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:50.371121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.371121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.371121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.371887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.411571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:51:50.498573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b52f015f-68bf-497c-b8ef-25da1a477c0c tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 204 len: 0 microversion: 2.1 time: 0.142401 Jun 28 17:51:50.499281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 307/601] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:51:50 2022] DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:51:50.507933 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:50.508660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:50.516673 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.517124 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.517902 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:50.518353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:50.661627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:50.671094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-05a0838f-fafd-4f85-baff-384f3fcaa751 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1671 microversion: 2.1 time: 0.167364 Jun 28 17:51:50.671690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 295/602] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:50 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:51.689524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:51.690103 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:51.697496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:51.697945 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:51.698732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:51.699144 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:51.843980 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:51.854066 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-698acbc7-9622-4995-bbf4-207a44bdaf56 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1671 microversion: 2.1 time: 0.168844 Jun 28 17:51:51.854656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 308/603] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:51 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:52.871558 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:52.872170 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:52.879774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:52.880506 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:52.881292 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:52.881734 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:53.030695 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:53.039905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-380b9d19-d989-4825-bc6c-8d576b7db551 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1671 microversion: 2.1 time: 0.171852 Jun 28 17:51:53.040175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 296/604] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:52 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:54.057342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:54.058591 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:54.061312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:54.067577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:54.068561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:54.069001 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:54.069441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:54.207614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:54.215606 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a311eb93-4830-43b9-9e65-f38b2fa25b32 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1671 microversion: 2.1 time: 0.162225 Jun 28 17:51:54.216167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 309/605] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:54 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:55.233656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:55.234362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:55.242075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:55.242529 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:55.243335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:55.243752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:55.328698 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:55.337512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4c804dad-6446-4ff2-8b81-78aa0108daf5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1604 microversion: 2.1 time: 0.108764 Jun 28 17:51:55.338188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 297/606] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:55 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1604 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:55.360297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-d4db2d97-4de4-4e4d-b8bf-8ab3eb0be069 req-234ae680-5b80-4bf5-a60e-3722944d01c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc", "name": "network-vif-deleted", "tag": "553daf34-1a16-4c07-b5ee-f59783300d84"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:55.372750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d4db2d97-4de4-4e4d-b8bf-8ab3eb0be069 req-234ae680-5b80-4bf5-a60e-3722944d01c4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:55.373440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d4db2d97-4de4-4e4d-b8bf-8ab3eb0be069 req-234ae680-5b80-4bf5-a60e-3722944d01c4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:55.387472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-d4db2d97-4de4-4e4d-b8bf-8ab3eb0be069 req-234ae680-5b80-4bf5-a60e-3722944d01c4 service nova] Creating event network-vif-deleted:553daf34-1a16-4c07-b5ee-f59783300d84 for instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc on hv-cinder-84801 Jun 28 17:51:55.392838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-d4db2d97-4de4-4e4d-b8bf-8ab3eb0be069 req-234ae680-5b80-4bf5-a60e-3722944d01c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036337 Jun 28 17:51:55.393476 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 310/607] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:51:56.355420 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:56.356110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:56.363270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:56.363667 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:56.364761 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:56.365391 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:56.434876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:56.444280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6e1334fc-f909-4c40-994c-148733c7fd9f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1604 microversion: 2.1 time: 0.092680 Jun 28 17:51:56.444896 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 298/608] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:56 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:57.462584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:57.463263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:57.471051 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:57.471503 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:57.472281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:57.472761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:57.547858 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:51:57.557862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9160a0a4-f621-4a32-a1af-6c130c7c59af tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 200 len: 1321 microversion: 2.1 time: 0.099436 Jun 28 17:51:57.558590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 311/609] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:57 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 1321 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:51:58.574996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:58.575611 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:51:58.582765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:58.583305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:58.584112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:51:58.584592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:51:58.598178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc HTTP/1.1 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:51:58.599877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:51:58.601464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc'} Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:51:58.602309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:51:58.604823 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:51:58.606372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:51:58.606372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4006798a-2293-4222-918e-99016d0d8201 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 404 len: 111 microversion: 2.1 time: 0.030452 Jun 28 17:51:58.606372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 299/610] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:51:58 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:51:58.612020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1c113bb0-5044-4bab-a415-6a05d961dfa4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '.version_select at 0x7f5771f34040>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:51:58.632374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1c113bb0-5044-4bab-a415-6a05d961dfa4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605740161" status: 202 len: 0 microversion: 2.1 time: 0.024196 Jun 28 17:51:58.633050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 312/611] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 28 17:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605740161 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:51:59.316962 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7abf3c8e-2814-49e6-8397-09e8c7bdcef4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: .version_select at 0x7f5772c173a0>, body: {"keypair": {"name": "tempest-keypair-2103372982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5o0nxvXYVXj7jfQUuCargq/dlxEFy3tPyOUGD8q4c6AtFsfDaqx+XtKM4QbGL4mou8umB7UnoCHrDja4EwmCGBAAGH8+etxrvxZpIbL13qNbp50s1Ena+NyWlbTM+N6Q=="}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:51:59.321131 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:59.337404 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-7abf3c8e-2814-49e6-8397-09e8c7bdcef4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for project 2f62aa1a154c498fbda7643ae9180098. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:51:59.341335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-7abf3c8e-2814-49e6-8397-09e8c7bdcef4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for user 77c37b0691e94ef784ee377e7ebfd6ef and project 2f62aa1a154c498fbda7643ae9180098. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:51:59.380006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7abf3c8e-2814-49e6-8397-09e8c7bdcef4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067060 Jun 28 17:51:59.380607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 300/612] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:51:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:00.704156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1761603067", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d1894c1-8b2c-45b7-9682-725f5d8a25f4"}], "security_groups": [{"name": "tempest-securitygroup--1629714245"}], "key_name": "tempest-keypair-2103372982", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:00.821882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] validate_networks() for [('9d1894c1-8b2c-45b7-9682-725f5d8a25f4', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:52:01.361561 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:52:01.361986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:52:01.362457 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:52:01.362864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:52:01.363278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:52:01.374616 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:01.375052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:01.375881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:01.376305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:01.401889 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for project 2f62aa1a154c498fbda7643ae9180098. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:52:01.406112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Getting quotas for user 77c37b0691e94ef784ee377e7ebfd6ef and project 2f62aa1a154c498fbda7643ae9180098. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:52:01.420584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:52:01.422862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:52:01.475682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f26cdc52-948d-40d8-b4ec-144ab872a961 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.778329 Jun 28 17:52:01.476369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 313/613] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:52:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:52:01.488599 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9f8cdfc3-614e-49b6-80af-9a8d8500a5a3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:01.489681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9f8cdfc3-614e-49b6-80af-9a8d8500a5a3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:01.556307 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9f8cdfc3-614e-49b6-80af-9a8d8500a5a3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:01.564490 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9f8cdfc3-614e-49b6-80af-9a8d8500a5a3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1238 microversion: 2.1 time: 0.080732 Jun 28 17:52:01.565124 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 301/614] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:01 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:52:02.166658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:02.167314 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:02.174060 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:02.174510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:02.175305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:02.175743 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:02.263264 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lazy-loading 'services' on Instance uuid 6d379ed5-48f0-4771-b202-40633054d1ed {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:02.340470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c758c658-8b8a-49b4-8d33-e5e696c31e16 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed/os-volume_attachments/85519670-7b8e-4e4c-8828-cede3519a510" status: 202 len: 0 microversion: 2.1 time: 0.177600 Jun 28 17:52:02.341322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 314/615] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:52:02 2022] DELETE /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed/os-volume_attachments/85519670-7b8e-4e4c-8828-cede3519a510 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:52:02.587201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:02.588049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:02.594834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:02.595297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:02.596102 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:02.596566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:02.599253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=83 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:02.675944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:02.685817 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c3db33c6-d3af-4ebc-96cb-026476a1ace7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1290 microversion: 2.1 time: 0.106747 Jun 28 17:52:02.686610 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 302/616] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:02 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:03.703653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:03.704374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:03.711612 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:03.712076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:03.712843 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:03.713270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:03.777494 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:03.784923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8a59e60c-aa0c-4df4-9203-1fdf6b491545 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1296 microversion: 2.1 time: 0.085349 Jun 28 17:52:03.785664 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 315/617] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:03 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:04.528688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:04.529313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:04.536622 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.537132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.539596 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.546811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.578871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:52:04.674867 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8e749392-49e8-4f66-a3c4-03746eb8ca02 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 204 len: 0 microversion: 2.1 time: 0.149849 Jun 28 17:52:04.679625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 303/618] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:52:04 2022] DELETE /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:52:04.687323 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:04.688066 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:04.694552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.695099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.696008 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.696706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.701638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:04.804666 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:04.805632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:04.822955 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.824101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.825185 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:04.825820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:04.853899 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:04.863000 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1f53726c-c4bb-4c4d-b8b6-3a9adae5f780 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1513 microversion: 2.1 time: 0.182109 Jun 28 17:52:04.863955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 316/619] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:04 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:05.027497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:05.043347 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-161e20f0-a5aa-4317-8080-273c51ec0bdb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.244216 Jun 28 17:52:05.044235 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 304/620] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:04 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:52:05.059673 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-47e92652-405d-41a7-84db-4b8300af9cac req-f2124ec2-9a89-4b2a-aacb-87d8546b195b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a96fab3-87dd-4823-bd8b-be1774e270d0", "tag": "da57294f-b9c7-4dc2-808d-c638635991ca"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:05.075649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-47e92652-405d-41a7-84db-4b8300af9cac req-f2124ec2-9a89-4b2a-aacb-87d8546b195b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:05.076587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-47e92652-405d-41a7-84db-4b8300af9cac req-f2124ec2-9a89-4b2a-aacb-87d8546b195b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:05.092828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-47e92652-405d-41a7-84db-4b8300af9cac req-f2124ec2-9a89-4b2a-aacb-87d8546b195b service nova] Creating event network-changed:da57294f-b9c7-4dc2-808d-c638635991ca for instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 on hv-cinder-84801 Jun 28 17:52:05.098633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-47e92652-405d-41a7-84db-4b8300af9cac req-f2124ec2-9a89-4b2a-aacb-87d8546b195b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189629 Jun 28 17:52:05.099281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 317/621] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:52:05.882131 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:05.883251 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:05.890184 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:05.890635 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:05.891409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:05.891843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:06.031023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:06.039508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5c03ac29-0a39-4232-a77f-02cc60423c42 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1513 microversion: 2.1 time: 0.162175 Jun 28 17:52:06.040116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 305/622] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:05 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:06.069943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:06.070645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:06.077355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:06.077807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:06.078579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:06.079012 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:06.221886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:06.230143 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dfbda350-ab8c-47a7-adba-cd1388bf578f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.165211 Jun 28 17:52:06.230754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 318/623] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:06 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:07.057087 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:07.058358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:07.066597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:07.067289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:07.068260 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:07.068719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:07.248448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:07.249032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:07.255823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:07.258610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:07.259767 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:07.261217 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:07.339026 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:07.352443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-aa738da0-90a2-496f-95d1-7f23e901216d tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1513 microversion: 2.1 time: 0.298539 Jun 28 17:52:07.353224 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 306/624] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:07 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:07.442455 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-7b213fd6-3df2-47f4-9ee7-23b90b1cdf75 req-c2c865b1-2e0d-4e88-8e3f-5c56ef67eae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379ed5-48f0-4771-b202-40633054d1ed", "name": "network-vif-deleted", "tag": "e924df90-c8b0-4049-8bc2-65baad7e1b58"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:07.448529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:07.454837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-7b213fd6-3df2-47f4-9ee7-23b90b1cdf75 req-c2c865b1-2e0d-4e88-8e3f-5c56ef67eae9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:07.455460 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-7b213fd6-3df2-47f4-9ee7-23b90b1cdf75 req-c2c865b1-2e0d-4e88-8e3f-5c56ef67eae9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:07.461377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b61ae37d-7f87-4a39-8797-518637d0c268 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.217359 Jun 28 17:52:07.462207 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 319/625] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:07 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:07.475527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-7b213fd6-3df2-47f4-9ee7-23b90b1cdf75 req-c2c865b1-2e0d-4e88-8e3f-5c56ef67eae9 service nova] Creating event network-vif-deleted:e924df90-c8b0-4049-8bc2-65baad7e1b58 for instance 6d379ed5-48f0-4771-b202-40633054d1ed on hv-cinder-84801 Jun 28 17:52:07.484735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-7b213fd6-3df2-47f4-9ee7-23b90b1cdf75 req-c2c865b1-2e0d-4e88-8e3f-5c56ef67eae9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129611 Jun 28 17:52:07.486574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 307/626] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:08.371663 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:08.372211 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:08.379519 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:08.379969 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:08.380767 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:08.381196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:08.425169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:08.425604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:08.426111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lazy-loading 'fault' on Instance uuid 6d379ed5-48f0-4771-b202-40633054d1ed {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:08.476912 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2c082e20fe4ab2a739d8e671816e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8293e6549634daab6d74028a64442db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:08.485747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ddf23d42-da58-4575-b1c0-622e6c415a27 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 200 len: 1309 microversion: 2.1 time: 0.118034 Jun 28 17:52:08.486407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 320/627] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:08 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:08.488019 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:08.488754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:08.496316 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:08.496800 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:08.497576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:08.498012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:08.649232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:08.656857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-54c37f60-a9c8-4d43-8d08-6ccebf2319a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.173494 Jun 28 17:52:08.657431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 308/628] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:08 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:09.018017 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:09.018905 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:09.025282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.025728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.026498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.026929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.124140 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'services' on Instance uuid 01690edf-8c3b-45d7-b6f3-f4e53a333c04 {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:09.204469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fbdab0c9-7961-4d7a-aaf4-086e54011b12 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments/a3c16e92-c412-44af-a428-3085ae78b9d4" status: 202 len: 0 microversion: 2.1 time: 0.190230 Jun 28 17:52:09.205240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 321/629] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:52:09 2022] DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments/a3c16e92-c412-44af-a428-3085ae78b9d4 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:52:09.219689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:09.221252 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:09.230912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.231361 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.232830 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.233497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.271652 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c435c23b-8f9f-414a-8c26-307b97a472f5 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060028 Jun 28 17:52:09.272122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 309/630] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:52:09 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:09.504554 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:09.505242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] [instance: 6d379ed5-48f0-4771-b202-40633054d1ed] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:09.512567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.513027 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.513775 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.514231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.528147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] HTTP exception thrown: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Request method failure captured: Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed HTTP/1.1 Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz9JG-oGgmeLMFZyk5N3fCRsXSa0483_dLaP8ahBpsaN5U1eApspqOLLr7JcErcjRHEEXXp0Poe_BB20l92PNc-odQ-99f8ebEPgo-6brywn2zBQrvvovuimMN8CjvNVrYDtBx9FMMSqRwXCIgOopbN2bW5eWG8_Z2BTdDC29CxIPlc Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: d8293e6549634daab6d74028a64442db Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:52:09.529835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8293e6549634daab6d74028a64442db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8293e6549634daab6d74028a64442db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8293e6549634daab6d74028a64442db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8293e6549634daab6d74028a64442db"}]}] Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: d8293e6549634daab6d74028a64442db Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-772461016 Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesSnapshotTestJSON-772461016-project Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 5b2c082e20fe4ab2a739d8e671816e63 Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesSnapshotTestJSON-772461016-project Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. Jun 28 17:52:09.531282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '6d379ed5-48f0-4771-b202-40633054d1ed'} Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:52:09.532127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. Jun 28 17:52:09.533470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:09.534736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] Returning 404 to user: Instance 6d379ed5-48f0-4771-b202-40633054d1ed could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:52:09.534736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5a1d80f6-9e74-4709-b8a0-070d805a2704 tempest-VolumesSnapshotTestJSON-772461016 tempest-VolumesSnapshotTestJSON-772461016-project] 10.222.0.43 "GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed" status: 404 len: 111 microversion: 2.1 time: 0.031556 Jun 28 17:52:09.534736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 322/631] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:09 2022] GET /compute/v2.1/servers/6d379ed5-48f0-4771-b202-40633054d1ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:52:09.673503 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:09.674110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:09.681377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.681825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.682762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:09.683373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:09.867602 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:09.879535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4beb9546-6e80-4ab0-8162-dcd003f67945 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.209755 Jun 28 17:52:09.885001 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 310/632] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:09 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:10.283868 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:10.285020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:10.292630 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.293096 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.294449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.295075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.331875 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b7251ad3-3412-4023-8aa3-1e3682e1f918 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051440 Jun 28 17:52:10.337954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 323/633] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:52:10 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:52:10.418119 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:10.418632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:10.425473 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.425925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.426714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.427149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.465576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:52:10.561903 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b615f939-a317-42b4-bf63-569a70c616ca tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 204 len: 0 microversion: 2.1 time: 0.148534 Jun 28 17:52:10.562931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 311/634] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:52:10 2022] DELETE /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:52:10.572649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:10.573348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:10.580047 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.580551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.581322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.581783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.720252 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:10.727925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-30d7538f-0383-4513-bf14-33a434b17384 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1689 microversion: 2.1 time: 0.160026 Jun 28 17:52:10.728521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 324/635] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:10 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:10.898543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:10.899210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:10.906094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.907047 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:10.907320 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:10.907759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:11.049636 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:11.059387 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0ee6ce94-2ba9-4cf7-b43b-84337bcb2950 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.165477 Jun 28 17:52:11.069029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 312/636] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:10 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:11.742433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:11.743251 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:11.748079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:11.748755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:11.756247 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:11.756921 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:11.757886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:11.758335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:11.899421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:11.910795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-90e0cfe8-c73d-4083-ab85-c6a7ade36b27 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1689 microversion: 2.1 time: 0.169325 Jun 28 17:52:11.911618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 325/637] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:11 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:12.079831 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:12.080499 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:12.082683 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:12.089850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:12.090324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:12.091100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:12.091532 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:12.238993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:12.248319 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3d381f13-1fa3-4ae1-a7b9-8f76920729d2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.175744 Jun 28 17:52:12.248965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 313/638] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:12 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:12.928790 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:12.930291 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:12.937648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:12.938092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:12.938883 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:12.939290 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:13.087840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:13.095389 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dcf43713-5fa9-4f15-8598-0c80de2209fd tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1689 microversion: 2.1 time: 0.170558 Jun 28 17:52:13.102750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 326/639] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:12 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:13.137797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-0b4407eb-7617-4cfe-8c74-50ba09522fbf req-c68be994-c3cd-40ea-888c-31d1f2e0fd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a96fab3-87dd-4823-bd8b-be1774e270d0", "name": "network-vif-plugged", "status": "completed", "tag": "da57294f-b9c7-4dc2-808d-c638635991ca"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:13.150822 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-0b4407eb-7617-4cfe-8c74-50ba09522fbf req-c68be994-c3cd-40ea-888c-31d1f2e0fd3f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:13.151396 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-0b4407eb-7617-4cfe-8c74-50ba09522fbf req-c68be994-c3cd-40ea-888c-31d1f2e0fd3f service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:13.166191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-0b4407eb-7617-4cfe-8c74-50ba09522fbf req-c68be994-c3cd-40ea-888c-31d1f2e0fd3f service nova] Creating event network-vif-plugged:da57294f-b9c7-4dc2-808d-c638635991ca for instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 on hv-cinder-84801 Jun 28 17:52:13.171156 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-0b4407eb-7617-4cfe-8c74-50ba09522fbf req-c68be994-c3cd-40ea-888c-31d1f2e0fd3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037862 Jun 28 17:52:13.171913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 314/640] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:13.266259 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:13.266887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:13.273887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:13.274309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:13.275081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:13.275510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:13.423503 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:13.432030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b11cca24-c516-4af9-8e5a-1ca95ace9680 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.169534 Jun 28 17:52:13.432682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 327/641] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:13 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:14.113678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:14.114297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:14.120912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:14.121322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:14.122143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:14.122750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:14.264068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:14.272125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-22032046-bb8b-4ca8-bc04-0a772f634fcb tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1689 microversion: 2.1 time: 0.162941 Jun 28 17:52:14.272734 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 315/642] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:14 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:14.448987 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:14.449731 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:14.455994 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:14.456462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:14.457261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:14.457685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:14.626798 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:14.635686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-170efcca-4ef6-4a70-b99d-32693bfe0958 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1364 microversion: 2.1 time: 0.191094 Jun 28 17:52:14.636287 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 328/643] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:14 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:15.290065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:15.290679 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:15.297813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:15.298238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:15.299052 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:15.299521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:15.513299 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:15.516065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:15.524950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d36aaf98-3d18-4872-bf0f-1c85b922065c tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1689 microversion: 2.1 time: 0.238878 Jun 28 17:52:15.525551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 316/644] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:15 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:15.653827 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:15.655255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:15.666280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:15.668235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:15.669425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:15.671188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.147240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:16.158939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0000214c-1f83-4f1a-b22b-5c431f378175 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1550 microversion: 2.1 time: 0.509234 Jun 28 17:52:16.159569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 329/645] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:15 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1550 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:16.177299 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:16.177789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:16.185592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.186056 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.186913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.187357 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.368550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f85ff36d-607d-4092-9832-b18c20246bfd tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194918 Jun 28 17:52:16.371105 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 317/646] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:52:16 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:16.403335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-8a8e5c8e-1f0a-4926-9163-2307141fdc2b req-18570270-5f17-4dce-9eb9-481b5558ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01690edf-8c3b-45d7-b6f3-f4e53a333c04", "name": "network-vif-deleted", "tag": "e9c5f59b-d294-48ed-ac38-46a6655e7ee0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:16.412911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8a8e5c8e-1f0a-4926-9163-2307141fdc2b req-18570270-5f17-4dce-9eb9-481b5558ae32 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.413405 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8a8e5c8e-1f0a-4926-9163-2307141fdc2b req-18570270-5f17-4dce-9eb9-481b5558ae32 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.428423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-8a8e5c8e-1f0a-4926-9163-2307141fdc2b req-18570270-5f17-4dce-9eb9-481b5558ae32 service nova] Creating event network-vif-deleted:e9c5f59b-d294-48ed-ac38-46a6655e7ee0 for instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 on hv-cinder-84801 Jun 28 17:52:16.438339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-8a8e5c8e-1f0a-4926-9163-2307141fdc2b req-18570270-5f17-4dce-9eb9-481b5558ae32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038655 Jun 28 17:52:16.442922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 330/647] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:52:16.543009 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:16.543552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:16.550661 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.551245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.552053 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.555882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.596143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:16.596904 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:16.597512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'fault' on Instance uuid 01690edf-8c3b-45d7-b6f3-f4e53a333c04 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:16.645545 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:16.654389 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3d780a97-f0ae-400d-a5ff-20c686c6849f tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 200 len: 1335 microversion: 2.1 time: 0.116335 Jun 28 17:52:16.655158 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 318/648] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:16 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:17.673826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:17.675168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 01690edf-8c3b-45d7-b6f3-f4e53a333c04] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:17.678442 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-9a42bc13-f3ea-4276-9e37-532694c4500c req-e76df714-c6c0-46e6-9743-3b7557627fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a96fab3-87dd-4823-bd8b-be1774e270d0", "tag": "da57294f-b9c7-4dc2-808d-c638635991ca"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:17.682696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:17.683386 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:17.684412 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:17.685033 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:17.699217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-9a42bc13-f3ea-4276-9e37-532694c4500c req-e76df714-c6c0-46e6-9743-3b7557627fc3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:17.699871 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-9a42bc13-f3ea-4276-9e37-532694c4500c req-e76df714-c6c0-46e6-9743-3b7557627fc3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:17.700286 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] HTTP exception thrown: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Request method failure captured: Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 HTTP/1.1 Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz52F2ohNuDNMxC-uWBoBNH0ysWcOkUbK87Smi1Ju0PVZ89hIdmVzvxoR4ErOTZmyHDjxZPh9A-tuTD4va1BKFjgXj_s8g-nehsNT6wQ7AbWodU1ytU301QTtbY5OB3VYDIDNAeEz6kXgsg65NE6JikkC1jrTPo_W2zOY-2eozFkihg Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:52:17.702192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}] Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 3a8c23b156174db28359e9f93c7378c8 Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. Jun 28 17:52:17.703470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '01690edf-8c3b-45d7-b6f3-f4e53a333c04'} Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:52:17.704224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. Jun 28 17:52:17.705498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:17.707962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Returning 404 to user: Instance 01690edf-8c3b-45d7-b6f3-f4e53a333c04 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:52:17.708882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-692cf0a8-9366-402d-a09f-74dde87c5537 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04" status: 404 len: 111 microversion: 2.1 time: 0.039918 Jun 28 17:52:17.712964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 331/649] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:17 2022] GET /compute/v2.1/servers/01690edf-8c3b-45d7-b6f3-f4e53a333c04 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:52:17.717814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2618a25f-6762-4a94-a9fe-84afb28a31b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '.version_select at 0x7f5771f35b80>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:17.731392 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-9a42bc13-f3ea-4276-9e37-532694c4500c req-e76df714-c6c0-46e6-9743-3b7557627fc3 service nova] Creating event network-changed:da57294f-b9c7-4dc2-808d-c638635991ca for instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 on hv-cinder-84801 Jun 28 17:52:17.739742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2618a25f-6762-4a94-a9fe-84afb28a31b2 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044326167" status: 202 len: 0 microversion: 2.1 time: 0.025550 Jun 28 17:52:17.740433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 332/650] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 28 17:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044326167 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:52:17.744338 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-9a42bc13-f3ea-4276-9e37-532694c4500c req-e76df714-c6c0-46e6-9743-3b7557627fc3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072231 Jun 28 17:52:17.744687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 319/651] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:18.662668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:18.663267 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:18.671033 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:18.671905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:18.672887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:18.673466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:18.729268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2da1c5b5-26b6-49a2-8c44-a3dc81767d04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments/88d1568a-dde5-4a97-862b-e1cde5c24cc4" status: 200 len: 194 microversion: 2.20 time: 0.072083 Jun 28 17:52:18.738864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 320/652] 10.222.0.43 () {60 vars in 1453 bytes} [Tue Jun 28 17:52:18 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments/88d1568a-dde5-4a97-862b-e1cde5c24cc4 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:18.807203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:18.807819 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:18.814711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:18.815124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:18.816839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:18.817294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:18.913961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lazy-loading 'services' on Instance uuid f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:18.997919 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3f476cc3-c0e2-41d7-8536-5acc3fc0daed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments/88d1568a-dde5-4a97-862b-e1cde5c24cc4" status: 202 len: 0 microversion: 2.20 time: 0.198054 Jun 28 17:52:18.998506 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 333/653] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Jun 28 17:52:18 2022] DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments/88d1568a-dde5-4a97-862b-e1cde5c24cc4 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:52:19.007879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:19.008961 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:19.016038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:19.016585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:19.018158 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:19.018996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:19.069784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-22d308b0-40d0-4be8-b04f-f7f8e0884f78 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065933 Jun 28 17:52:19.070604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 321/654] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:52:19 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:20.083380 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:20.084419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:20.091645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:20.092102 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:20.092922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:20.093372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:20.118714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:20.125785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-918a2279-b647-46b6-9db5-b4a9b0288391 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047361 Jun 28 17:52:20.126363 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 334/655] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:52:20 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:21.139086 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:21.140023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:21.148623 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:21.149107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:21.149910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:21.150346 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:21.184993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e60d92f8-ffe8-4f7c-ac68-dde9c50fcf9f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049899 Jun 28 17:52:21.185594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 322/656] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:52:21 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:22.203998 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:22.205418 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:22.216768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:22.217500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:22.218775 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:22.219469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:22.257187 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4b44f804-bed5-4dc1-a871-83819c4defa6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061074 Jun 28 17:52:22.257845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 335/657] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:52:22 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:23.271412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:23.272414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:23.280034 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.280539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.281334 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.281774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.315177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-18f055f8-efa3-4a80-a41f-19fad5aeeed7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048405 Jun 28 17:52:23.315774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 323/658] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:52:23 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:52:23.385534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:23.386163 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:23.393923 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.394370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.395226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.395691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.422918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:52:23.512683 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-da8b06a3-ad7c-4d4b-9ffb-b2c52c885b37 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 204 len: 0 microversion: 2.20 time: 0.130758 Jun 28 17:52:23.513393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 336/659] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 28 17:52:23 2022] DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 17:52:23.522677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:23.523453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:23.530199 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.530654 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.531448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:23.531889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:23.670934 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:23.680134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:23.681668 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:23.683427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9f84faac-19be-45e4-91ca-8c3921a1b464 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.165192 Jun 28 17:52:23.684242 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 324/660] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:23 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:52:24.169738 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:24.170312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:24.172272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:24.179993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.180715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.181953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.182393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.212268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:52:24.309844 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-10abf11b-4c6f-44ab-905f-04b86b832cc0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 204 len: 0 microversion: 2.1 time: 0.143746 Jun 28 17:52:24.310859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 337/661] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:52:24 2022] DELETE /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:52:24.320848 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:24.321758 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:24.335186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.335920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.337739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.338418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.491213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:24.506409 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1b738f05-53b7-42ec-ab39-84a7777c3467 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1508 microversion: 2.1 time: 0.190066 Jun 28 17:52:24.507464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 325/662] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:24 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:24.704045 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:24.704878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:24.713184 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.713631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.714428 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:24.714859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:24.892507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:24.901812 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:24.903388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:24.904549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a6528de9-6899-4fa8-98b0-4ea56607bb6c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.205002 Jun 28 17:52:24.905123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 338/663] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:24 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:52:25.524502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:25.525036 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:25.532107 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:25.532596 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:25.533373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:25.533827 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:25.685576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:25.696173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-67330436-ba86-4ff0-8976-7dbb4024bbd0 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1508 microversion: 2.1 time: 0.176528 Jun 28 17:52:25.696930 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 326/664] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:25 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:25.923732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:25.924321 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:25.931500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:25.931954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:25.932778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:25.933212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:26.075772 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:26.086998 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:26.088607 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:26.089785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-51dc2431-0d20-45da-9b0c-c6b3d54b35a8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.170262 Jun 28 17:52:26.090351 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 339/665] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:25 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:26.714982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:26.716345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:26.723193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:26.723695 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:26.725485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:26.726425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:27.022681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:27.030958 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-32b07368-3648-4b32-b422-3fe58328c125 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 200 len: 1508 microversion: 2.1 time: 0.320392 Jun 28 17:52:27.031533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 327/666] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:26 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:27.108348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:27.108950 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:27.115433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:27.116209 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:27.117803 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:27.118234 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:27.276008 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-28a747dc-ea11-4f32-832b-92bafe32b1a7 req-a205b274-479e-4c27-a348-132c61f4381a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427293a6-e0fd-4178-9bff-2277df234adb", "name": "network-vif-deleted", "tag": "dfe9a6f3-14fe-4241-94d3-47544bb83c60"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:27.292219 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-28a747dc-ea11-4f32-832b-92bafe32b1a7 req-a205b274-479e-4c27-a348-132c61f4381a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:27.292917 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-28a747dc-ea11-4f32-832b-92bafe32b1a7 req-a205b274-479e-4c27-a348-132c61f4381a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:27.355772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-28a747dc-ea11-4f32-832b-92bafe32b1a7 req-a205b274-479e-4c27-a348-132c61f4381a service nova] Creating event network-vif-deleted:dfe9a6f3-14fe-4241-94d3-47544bb83c60 for instance 427293a6-e0fd-4178-9bff-2277df234adb on hv-cinder-84801 Jun 28 17:52:27.365850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-28a747dc-ea11-4f32-832b-92bafe32b1a7 req-a205b274-479e-4c27-a348-132c61f4381a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095010 Jun 28 17:52:27.367023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 328/667] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:27.377524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:27.388080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:27.390929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:27.393435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bae0a140-accf-4457-978c-7d5a704c2b6e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 200 len: 1721 microversion: 2.20 time: 0.288744 Jun 28 17:52:27.394486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 340/668] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:27 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:27.723716 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-523cbd2c-0d59-43dd-8400-036db3801cc6 req-498b5fca-7e52-4b0e-95e2-6dac1b23b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b", "name": "network-vif-deleted", "tag": "f48c9969-39e8-466f-9134-3148cac12f49"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:27.733438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-523cbd2c-0d59-43dd-8400-036db3801cc6 req-498b5fca-7e52-4b0e-95e2-6dac1b23b0ed service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:27.733878 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-523cbd2c-0d59-43dd-8400-036db3801cc6 req-498b5fca-7e52-4b0e-95e2-6dac1b23b0ed service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:27.746151 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-523cbd2c-0d59-43dd-8400-036db3801cc6 req-498b5fca-7e52-4b0e-95e2-6dac1b23b0ed service nova] Creating event network-vif-deleted:f48c9969-39e8-466f-9134-3148cac12f49 for instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b on hv-cinder-84801 Jun 28 17:52:27.751046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-523cbd2c-0d59-43dd-8400-036db3801cc6 req-498b5fca-7e52-4b0e-95e2-6dac1b23b0ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Jun 28 17:52:27.752027 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 329/669] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:28.049121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:28.049648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: 427293a6-e0fd-4178-9bff-2277df234adb] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:28.061532 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.061668 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.064788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.065251 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.084276 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] HTTP exception thrown: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Request method failure captured: Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb HTTP/1.1 Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz52F2ohNuDNMxC-uWBoBNH0ysWcOkUbK87Smi1Ju0PVZ89hIdmVzvxoR4ErOTZmyHDjxZPh9A-tuTD4va1BKFjgXj_s8g-nehsNT6wQ7AbWodU1ytU301QTtbY5OB3VYDIDNAeEz6kXgsg65NE6JikkC1jrTPo_W2zOY-2eozFkihg Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:52:28.087129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}] Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 3a8c23b156174db28359e9f93c7378c8 Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. Jun 28 17:52:28.088632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '427293a6-e0fd-4178-9bff-2277df234adb'} Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:52:28.089388 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. Jun 28 17:52:28.090602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.093420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Returning 404 to user: Instance 427293a6-e0fd-4178-9bff-2277df234adb could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:52:28.094707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a67ae51b-ff15-4ebc-ba19-27790354ab92 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb" status: 404 len: 111 microversion: 2.1 time: 0.049886 Jun 28 17:52:28.095462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 341/670] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:28 2022] GET /compute/v2.1/servers/427293a6-e0fd-4178-9bff-2277df234adb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:52:28.105022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:28.105724 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:28.112344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.112821 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.113631 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.114250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.149030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:52:28.252327 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9cab3219-4828-41f8-accd-5c65c374cee3 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 204 len: 0 microversion: 2.1 time: 0.151609 Jun 28 17:52:28.252965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 330/671] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:52:28 2022] DELETE /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:52:28.262063 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:28.262680 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:28.270350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.270762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.271762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.272237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.412507 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:28.413598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:28.421534 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.422266 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.423053 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:28.423645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:28.439793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:28.448112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c1a27bd4-a923-49b1-9692-695ca7243728 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.189957 Jun 28 17:52:28.449496 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:52:28.450473 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 342/672] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:28 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b HTTP/1.1 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:52:28.451808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:52:28.454605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b'} Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:52:28.457140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:52:28.460150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:52:28.462731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:52:28.462731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ecab7261-749f-41a2-981e-beebd2bf8647 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 404 len: 111 microversion: 2.20 time: 0.046010 Jun 28 17:52:28.462731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 331/673] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:28 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 28 17:52:28.464823 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6c14c591-7e05-41f1-beb3-3eeeadb1f5c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '.version_select at 0x7f5771ede670>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:28.485672 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6c14c591-7e05-41f1-beb3-3eeeadb1f5c7 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62440747" status: 204 len: 0 microversion: 2.20 time: 0.024791 Jun 28 17:52:28.486280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 343/674] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Jun 28 17:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62440747 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 28 17:52:29.246016 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-551f9a49-2efa-4b52-96a3-0d10730542db tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: .version_select at 0x7f577288e160>, body: {"keypair": {"name": "tempest-keypair-1265824213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdBGsWjBUE/6NJTzibjHTCpkN2mpDzzMBqXSQjHqq0GhFL+K56sngUIkrd77PyhOuMborTWPBga+C6nsNiak19H2Rp2eV/Uem7mjGAhM2G1+Uy0YmBUUy9y0OVybezDOg=="}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:29.263956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-551f9a49-2efa-4b52-96a3-0d10730542db tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for project 617c65d2596b4cce9db8ef1806b98460. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:52:29.267031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:29.270029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-551f9a49-2efa-4b52-96a3-0d10730542db tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for user 2a63dee5a6194467a325c9499cd89bb0 and project 617c65d2596b4cce9db8ef1806b98460. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:52:29.302900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-551f9a49-2efa-4b52-96a3-0d10730542db tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.061191 Jun 28 17:52:29.303594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 332/675] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jun 28 17:52:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 28 17:52:29.466222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:29.466927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:29.473562 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:29.474005 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:29.474789 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:29.475297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:29.641357 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:29.649729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cfcc4192-f99f-4876-a9d7-8407ffb79f61 tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.188482 Jun 28 17:52:29.650309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 344/676] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:29 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:30.670038 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:30.670920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:30.681460 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:30.682024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:30.683239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:30.684017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:30.864076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1774908930", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f3a3ed5-dd16-44db-94f8-523fb0ae05d5"}], "security_groups": [{"name": "tempest-securitygroup--863660657"}], "key_name": "tempest-keypair-1265824213", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:30.879217 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:30.887919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-61f6da88-8526-4f10-9d72-ae6525d7a52e tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1522 microversion: 2.1 time: 0.224154 Jun 28 17:52:30.888699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 333/677] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:30 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:30.989111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] validate_networks() for [('8f3a3ed5-dd16-44db-94f8-523fb0ae05d5', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:52:31.449644 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-f06df062-ae60-4f9c-8424-77648d92bc1d req-3c6bbe33-b557-43e3-9326-745b80b6886b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf62a85-c4fd-4de1-8b36-5868f2a1fede", "name": "network-vif-deleted", "tag": "d8954c8e-6ae5-494d-8929-f95f1dcd8ca0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:31.464747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-f06df062-ae60-4f9c-8424-77648d92bc1d req-3c6bbe33-b557-43e3-9326-745b80b6886b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.465538 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-f06df062-ae60-4f9c-8424-77648d92bc1d req-3c6bbe33-b557-43e3-9326-745b80b6886b service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.490348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-f06df062-ae60-4f9c-8424-77648d92bc1d req-3c6bbe33-b557-43e3-9326-745b80b6886b service nova] Creating event network-vif-deleted:d8954c8e-6ae5-494d-8929-f95f1dcd8ca0 for instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede on hv-cinder-84801 Jun 28 17:52:31.500186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-f06df062-ae60-4f9c-8424-77648d92bc1d req-3c6bbe33-b557-43e3-9326-745b80b6886b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057347 Jun 28 17:52:31.501231 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 334/678] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:52:31.509563 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:52:31.510178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:52:31.510840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:52:31.511274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:52:31.511741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:52:31.521730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.522570 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.523961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.524639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.548190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for project 617c65d2596b4cce9db8ef1806b98460. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:52:31.553133 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Getting quotas for user 2a63dee5a6194467a325c9499cd89bb0 and project 617c65d2596b4cce9db8ef1806b98460. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:52:31.566459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:52:31.569195 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:52:31.623419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-62084307-fd6a-49ff-a9ce-ec31351ee43a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.765986 Jun 28 17:52:31.623947 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 345/679] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Jun 28 17:52:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 17:52:31.635176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:31.635804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:31.694820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:31.707725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:31.709301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:31.710586 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5f5fa5f9-6de5-477b-b5ab-db663c7e7de8 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1282 microversion: 2.20 time: 0.079933 Jun 28 17:52:31.721812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 335/680] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:31 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:31.905386 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:31.906701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:31.915395 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.916370 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.917268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.917946 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.954385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:31.954942 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:31.955401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lazy-loading 'fault' on Instance uuid cdf62a85-c4fd-4de1-8b36-5868f2a1fede {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:52:32.023665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8c23b156174db28359e9f93c7378c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e94e7c524d4bafaf7dd36b7edb48fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:32.032244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-96cb35c4-7471-4d61-98f0-7bdcafb1589b tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 200 len: 1311 microversion: 2.1 time: 0.131095 Jun 28 17:52:32.033175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 346/681] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:31 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 1311 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:32.730706 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:32.731598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:32.738796 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:32.739260 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:32.740048 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:32.740526 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:32.878808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:32.892465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:32.894872 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:32.896278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-26b34990-8afc-4ac3-8aef-05c84f7318a5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1342 microversion: 2.20 time: 0.170287 Jun 28 17:52:32.897249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 336/682] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:32 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:52:33.055614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:33.056864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] [instance: cdf62a85-c4fd-4de1-8b36-5868f2a1fede] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:33.067244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:33.068133 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:33.069245 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:33.069759 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:33.085872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] HTTP exception thrown: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Request method failure captured: Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede HTTP/1.1 Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz52F2ohNuDNMxC-uWBoBNH0ysWcOkUbK87Smi1Ju0PVZ89hIdmVzvxoR4ErOTZmyHDjxZPh9A-tuTD4va1BKFjgXj_s8g-nehsNT6wQ7AbWodU1ytU301QTtbY5OB3VYDIDNAeEz6kXgsg65NE6JikkC1jrTPo_W2zOY-2eozFkihg Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:52:33.087623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/54e94e7c524d4bafaf7dd36b7edb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/54e94e7c524d4bafaf7dd36b7edb48fb"}]}] Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 54e94e7c524d4bafaf7dd36b7edb48fb Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-362429255 Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 3a8c23b156174db28359e9f93c7378c8 Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-362429255-project Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. Jun 28 17:52:33.090232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'cdf62a85-c4fd-4de1-8b36-5868f2a1fede'} Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:52:33.091747 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. Jun 28 17:52:33.094423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:52:33.097623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] Returning 404 to user: Instance cdf62a85-c4fd-4de1-8b36-5868f2a1fede could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:52:33.097623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7fe98b05-b0f6-4352-bed2-1949cb41e3da tempest-ServerRescueNegativeTestJSON-362429255 tempest-ServerRescueNegativeTestJSON-362429255-project] 10.222.0.43 "GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede" status: 404 len: 111 microversion: 2.1 time: 0.042100 Jun 28 17:52:33.097623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 347/683] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:52:33 2022] GET /compute/v2.1/servers/cdf62a85-c4fd-4de1-8b36-5868f2a1fede => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:52:33.937324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:33.940177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:33.952801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:33.953923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:33.955602 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:33.956286 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:33.966703 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:34.267552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:34.281088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:34.282661 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:34.283885 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6a621dff-8522-49e5-8ec8-fa444ff4bf8a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.360076 Jun 28 17:52:34.296420 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 337/684] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:33 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:34.772178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-6be680a9-d98c-4c5f-a567-058fdb13bd46 req-826e275e-eead-4a68-9e6d-1257f69005d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:34.849890 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6be680a9-d98c-4c5f-a567-058fdb13bd46 req-826e275e-eead-4a68-9e6d-1257f69005d3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:34.850678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6be680a9-d98c-4c5f-a567-058fdb13bd46 req-826e275e-eead-4a68-9e6d-1257f69005d3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:34.886880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-6be680a9-d98c-4c5f-a567-058fdb13bd46 req-826e275e-eead-4a68-9e6d-1257f69005d3 service nova] Creating event network-changed:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:52:34.900982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-6be680a9-d98c-4c5f-a567-058fdb13bd46 req-826e275e-eead-4a68-9e6d-1257f69005d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145743 Jun 28 17:52:34.904652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 348/685] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:35.313843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:35.315167 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:35.325150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:35.325150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:35.325150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:35.325150 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:35.511161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:35.522672 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:35.524778 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:35.525887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-45bc033e-2ba2-40a1-9fc1-fca9c0cf9a2c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.217117 Jun 28 17:52:35.526459 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 338/686] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:35 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:36.547385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:36.547385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:36.556023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:36.556422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:36.557385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:36.557880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:36.735108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:36.748706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:36.752198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:36.753720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c1b18c5f-45fa-4c20-8716-e79e448e84e6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.213342 Jun 28 17:52:36.756431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 349/687] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:36 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:37.778661 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:37.779232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:37.794746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:37.795505 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:37.796291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:37.796741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:37.947730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:37.956864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:37.958349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:37.959887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e4b6463c-b951-4697-886b-150b254c5b2b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.185632 Jun 28 17:52:37.960706 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 339/688] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:37 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:38.978538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:38.979343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:38.987682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:38.988138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:38.988968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:38.989446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:39.176286 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:39.184782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:39.186260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:39.187368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f59bbaa8-8b6d-4311-993f-5c8f6b43e5fe tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.213119 Jun 28 17:52:39.187944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 350/689] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:38 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:40.206743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:40.207652 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:40.215293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:40.215750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:40.216566 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:40.217002 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:40.373193 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:40.382774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:40.384268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:40.385458 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a486502e-8de2-4669-84f5-85e4f9dfc90c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.183348 Jun 28 17:52:40.386024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 340/690] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:40 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:40.397378 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-6d1e2618-43d8-4c9a-a0c4-8d4a756642bd req-9e0da96a-31f7-466b-b6bd-e0be272b8164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "name": "network-vif-plugged", "status": "completed", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:40.407030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6d1e2618-43d8-4c9a-a0c4-8d4a756642bd req-9e0da96a-31f7-466b-b6bd-e0be272b8164 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:40.407030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-6d1e2618-43d8-4c9a-a0c4-8d4a756642bd req-9e0da96a-31f7-466b-b6bd-e0be272b8164 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:40.418603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-6d1e2618-43d8-4c9a-a0c4-8d4a756642bd req-9e0da96a-31f7-466b-b6bd-e0be272b8164 service nova] Creating event network-vif-plugged:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:52:40.423850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-6d1e2618-43d8-4c9a-a0c4-8d4a756642bd req-9e0da96a-31f7-466b-b6bd-e0be272b8164 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185842 Jun 28 17:52:40.424502 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 351/691] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:40.862929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1ea9c6aa-3feb-464e-947e-4611544c89db tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5772a204c0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:40.913295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1ea9c6aa-3feb-464e-947e-4611544c89db tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8944063b-8269-47ba-bb03-8a89397a7ec7" status: 200 len: 349 microversion: 2.1 time: 0.053752 Jun 28 17:52:40.914132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 341/692] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:52:40 2022] GET /compute/v2.1/os-volumes/8944063b-8269-47ba-bb03-8a89397a7ec7 => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:52:41.410539 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:41.411233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:41.419139 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:41.419519 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:41.420296 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:41.420762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:41.423433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:41.538560 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:41.561585 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:41.570234 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:41.580913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:41.582411 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:41.583720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-619878bc-45e7-43a3-afc9-2cafc64c86d0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1407 microversion: 2.20 time: 0.180788 Jun 28 17:52:41.584512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 352/693] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:41 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:42.282843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:42.287160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-204f7af8-b5c1-4d11-a3e4-eef0f9842562 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f577288e3a0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:42.339041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-204f7af8-b5c1-4d11-a3e4-eef0f9842562 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/75b47922-e605-449a-a139-b8891ea136fd" status: 200 len: 350 microversion: 2.1 time: 0.057883 Jun 28 17:52:42.339846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 342/694] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:52:42 2022] GET /compute/v2.1/os-volumes/75b47922-e605-449a-a139-b8891ea136fd => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:42.604249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:42.604841 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:42.611807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:42.612238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:42.613213 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:42.613641 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:42.754601 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:42.765507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:42.766986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:52:42.768565 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1d123abd-4cdd-4dc7-ad29-4a9f782368a3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1599 microversion: 2.20 time: 0.169646 Jun 28 17:52:42.769131 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 353/695] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:52:42 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:52:42.786771 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:42.787172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:42.794722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:42.795162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:42.795917 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:42.796348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:42.885776 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d03b99aa-a1a8-40f2-96ab-1bd8e2f775fa tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102969 Jun 28 17:52:42.886405 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 343/696] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Jun 28 17:52:42 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:52:43.721618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-229a858a-5dcd-49fa-ba70-8239ac28403b tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5772166ee0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:43.792608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-229a858a-5dcd-49fa-ba70-8239ac28403b tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4f40ac1a-085b-4df3-98f2-b7ae12d2f3df" status: 200 len: 350 microversion: 2.1 time: 0.078326 Jun 28 17:52:43.794034 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 354/697] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:52:43 2022] GET /compute/v2.1/os-volumes/4f40ac1a-085b-4df3-98f2-b7ae12d2f3df => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:43.809039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e98f7c5a-7715-4892-baca-8dde067aee2d tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f57720184c0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:43.894619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e98f7c5a-7715-4892-baca-8dde067aee2d tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.089979 Jun 28 17:52:43.895227 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 344/698] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jun 28 17:52:43 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:43.908415 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5f3e5a1b-878a-43c5-a56a-17d16ec5bfb0 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5772115c10>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:43.991681 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5f3e5a1b-878a-43c5-a56a-17d16ec5bfb0 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086944 Jun 28 17:52:43.992487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 355/699] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Jun 28 17:52:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:44.005954 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7c87e69d-4acd-450b-9704-8138ddd5dcf6 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f57728b3040>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.098116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7c87e69d-4acd-450b-9704-8138ddd5dcf6 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.096417 Jun 28 17:52:44.098893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 345/700] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:44.110299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cb358e23-c2b7-44dc-87de-950d3a63e013 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5771f1faf0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.242179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cb358e23-c2b7-44dc-87de-950d3a63e013 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135374 Jun 28 17:52:44.243193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 356/701] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:44.256905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-8b196b2d-2a2e-42e2-afec-884a4f1c497a req-46c15876-6c22-4cc0-bc44-8c43bd8d4c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:44.265459 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fd38de55-1196-4710-9964-2eed66c8aa2e tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5771f1f940>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.266956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-8b196b2d-2a2e-42e2-afec-884a4f1c497a req-46c15876-6c22-4cc0-bc44-8c43bd8d4c03 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:44.267428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-8b196b2d-2a2e-42e2-afec-884a4f1c497a req-46c15876-6c22-4cc0-bc44-8c43bd8d4c03 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:44.282583 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-8b196b2d-2a2e-42e2-afec-884a4f1c497a req-46c15876-6c22-4cc0-bc44-8c43bd8d4c03 service nova] Creating event network-changed:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:52:44.292154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-8b196b2d-2a2e-42e2-afec-884a4f1c497a req-46c15876-6c22-4cc0-bc44-8c43bd8d4c03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038345 Jun 28 17:52:44.292986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 346/702] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:44.360481 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fd38de55-1196-4710-9964-2eed66c8aa2e tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101960 Jun 28 17:52:44.361062 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 357/703] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:44.376204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-dc870e19-ab76-4d9f-a7ed-ef7f56e485a4 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f577206eca0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.463300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-dc870e19-ab76-4d9f-a7ed-ef7f56e485a4 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.091245 Jun 28 17:52:44.468692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 347/704] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:44.475473 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-177ac00d-8372-46d4-ac0e-9322c6ac4f3c tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f5771eeeb80>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.565066 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-177ac00d-8372-46d4-ac0e-9322c6ac4f3c tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092866 Jun 28 17:52:44.565912 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 358/705] 10.222.0.43 () {58 vars in 1187 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:44.586861 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-326cfdd7-77a6-4e91-96b2-25b396e222a6 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] Calling method '.version_select at 0x7f57728a0a60>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:44.702041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-326cfdd7-77a6-4e91-96b2-25b396e222a6 tempest-VolumesTestJSON-1167509369 tempest-VolumesTestJSON-1167509369-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.120451 Jun 28 17:52:44.703082 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 348/706] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jun 28 17:52:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:52:53.996149 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:52:53.996834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:54.001954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:54.002871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=11 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:54.008267 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:54.009006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:54.009797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:54.010229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:54.046290 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9107c922-2f2e-4802-9032-590397ddf1e4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/ips" status: 200 len: 146 microversion: 2.1 time: 0.054655 Jun 28 17:52:54.047147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 359/707] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:52:53 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:52:57.673728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:57.674741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=29 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:57.680990 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e90c71b0-2898-4236-9095-36d2dbe6a1b8"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:52:57.682876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:52:57.692017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:57.692517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:57.693332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:52:57.693780 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:52:58.050463 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-82910775-d3a1-437e-8408-45d19246fcc3 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379080 Jun 28 17:52:58.051215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 349/708] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:52:57 2022] POST /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:05.768367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:05.769342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:05.772431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=4 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:05.782436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:05.783216 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:05.784620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:05.785397 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:05.828479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b43ef905-dabb-4682-9763-5a69207f598f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064704 Jun 28 17:53:05.829062 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 360/709] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:53:05 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:05.846709 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:05.847843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:05.859632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:05.860846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:05.862254 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:05.862822 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:05.919748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-86df748f-7e19-4611-bbcc-bbc22509486e tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8" status: 200 len: 194 microversion: 2.1 time: 0.082158 Jun 28 17:53:05.924422 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 350/710] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 28 17:53:05 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:07.336088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e6a96b7-ec40-4684-abb1-9359664b679b"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:07.337332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:07.344521 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:07.345047 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:07.345932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:07.346434 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:07.648317 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5ca651a6-0f34-47d6-919b-8a92b201c2f9 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "POST /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316694 Jun 28 17:53:07.649086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 361/711] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:53:07 2022] POST /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:15.318509 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:15.319737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:15.327765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.328249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.329207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.329669 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.366565 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-83483009-6d1b-4599-9456-aefa91ce920d tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052094 Jun 28 17:53:15.367173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 351/712] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:53:15 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:53:15.513231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:15.514028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:15.523075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.523531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.524323 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.524792 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.557384 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-81f51453-0697-4fb2-ad90-e4e590e9bacf tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8" status: 200 len: 194 microversion: 2.1 time: 0.049868 Jun 28 17:53:15.558239 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 362/713] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 28 17:53:15 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:15.570232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:15.570541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:15.578502 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.579067 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.579952 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:15.580595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:15.678173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lazy-loading 'services' on Instance uuid 4a96fab3-87dd-4823-bd8b-be1774e270d0 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:53:15.761303 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d995e48d-ef8d-407a-876e-852b3d5c02e5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8" status: 202 len: 0 microversion: 2.1 time: 0.195796 Jun 28 17:53:15.762120 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 352/714] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:53:15 2022] DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/e90c71b0-2898-4236-9095-36d2dbe6a1b8 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:53:16.891300 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:16.892525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:16.900260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:16.900744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:16.901636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:16.902091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:16.937988 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-240990e3-5dc2-4545-ade8-7caad933b651 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/2e6a96b7-ec40-4684-abb1-9359664b679b" status: 200 len: 194 microversion: 2.1 time: 0.051241 Jun 28 17:53:16.938717 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 363/715] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 28 17:53:16 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/2e6a96b7-ec40-4684-abb1-9359664b679b => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:53:16.956171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:16.957326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:16.970161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:16.971059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:16.972710 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:16.973712 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:17.090613 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lazy-loading 'services' on Instance uuid 4a96fab3-87dd-4823-bd8b-be1774e270d0 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:53:17.183857 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5a70c9e9-1787-4e9e-aa97-dd6555df2ca6 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/2e6a96b7-ec40-4684-abb1-9359664b679b" status: 202 len: 0 microversion: 2.1 time: 0.235658 Jun 28 17:53:17.184697 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 353/716] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:53:16 2022] DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments/2e6a96b7-ec40-4684-abb1-9359664b679b => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:53:18.370185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:18.371159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:18.377997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.378445 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.379196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.379640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.410638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-851bd5a2-0f55-4ae3-a0f9-fc5926a07917 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044661 Jun 28 17:53:18.411263 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 364/717] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:53:18 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:53:18.539648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:18.540768 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:18.547992 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.548468 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.549264 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.549696 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.584351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3b47bf0a-bdef-4f67-9466-0ed2c5b631a4 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049071 Jun 28 17:53:18.585048 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 354/718] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:53:18 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:53:18.651082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:18.651608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:18.658131 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.658581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.659367 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.659802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.688106 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:53:18.773353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b861a1fd-de56-4c98-a355-d0d8f4f63ae7 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 204 len: 0 microversion: 2.1 time: 0.125765 Jun 28 17:53:18.773933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 365/719] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:53:18 2022] DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:53:18.789159 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:18.790280 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:18.798160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.798582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.799392 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:18.799966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:18.948136 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:18.957225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2bbf341e-a65e-4e10-8e8b-d1cba443e0d1 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1675 microversion: 2.1 time: 0.175790 Jun 28 17:53:18.957225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 355/720] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:18 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:53:19.975507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:19.976652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:19.986685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:19.987392 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:19.988618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:19.989280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:20.160581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:20.168688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b81101d2-5d2a-4f8d-a84f-df62cdd4ee25 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1675 microversion: 2.1 time: 0.198232 Jun 28 17:53:20.169283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 366/721] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:19 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:53:20.188479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:20.189171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:20.196803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:20.197360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:20.198284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:20.198806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:20.225783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c049611e-f861-44dc-9ae8-0c0215a4a796 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/ips" status: 200 len: 152 microversion: 2.20 time: 0.040916 Jun 28 17:53:20.226283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 356/722] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Jun 28 17:53:20 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:53:21.187953 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:21.189002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:21.197837 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:21.198666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:21.199498 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:21.200015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:21.361101 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c37b0691e94ef784ee377e7ebfd6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f62aa1a154c498fbda7643ae9180098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:21.370522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d93db637-8b3c-48ef-adc5-8b694264558b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 200 len: 1675 microversion: 2.1 time: 0.186609 Jun 28 17:53:21.371774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 367/723] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:21 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:53:21.713101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-4b3480bd-89ff-4ecd-9761-50670f421d27 req-69d26196-72b7-4ea5-9fb0-946fad58a42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a96fab3-87dd-4823-bd8b-be1774e270d0", "name": "network-vif-deleted", "tag": "da57294f-b9c7-4dc2-808d-c638635991ca"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:21.723472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-4b3480bd-89ff-4ecd-9761-50670f421d27 req-69d26196-72b7-4ea5-9fb0-946fad58a42e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:21.724039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-4b3480bd-89ff-4ecd-9761-50670f421d27 req-69d26196-72b7-4ea5-9fb0-946fad58a42e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:21.741457 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-4b3480bd-89ff-4ecd-9761-50670f421d27 req-69d26196-72b7-4ea5-9fb0-946fad58a42e service nova] Creating event network-vif-deleted:da57294f-b9c7-4dc2-808d-c638635991ca for instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 on hv-cinder-84801 Jun 28 17:53:21.747574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-4b3480bd-89ff-4ecd-9761-50670f421d27 req-69d26196-72b7-4ea5-9fb0-946fad58a42e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038414 Jun 28 17:53:21.748309 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 357/724] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:22.215884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:22.217530 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:22.228863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.229628 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.230725 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.231390 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.259535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lazy-loading 'flavor' on Instance uuid 5f29a2a9-c5c7-495e-b14a-ac464d76f97f {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:53:22.393592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:22.395442 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:22.407030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.407629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.408787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.409846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.436354 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 HTTP/1.1 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:53:22.441313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:22.443985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '4a96fab3-87dd-4823-bd8b-be1774e270d0'} Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:53:22.445467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:22.447522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:22.451779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:53:22.454988 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f23c379b-e211-42df-abfd-f043b766707b tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 404 len: 111 microversion: 2.1 time: 0.069287 Jun 28 17:53:22.456444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 358/725] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:22 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:22.468511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-96146dd1-8103-46b2-a70a-f0f40f25b9a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '.version_select at 0x7f57728b3e50>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:22.493788 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-96146dd1-8103-46b2-a70a-f0f40f25b9a0 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103372982" status: 202 len: 0 microversion: 2.1 time: 0.030711 Jun 28 17:53:22.494987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 359/726] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 28 17:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103372982 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:53:22.581128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8be35f87-0883-4548-b9cd-9b8e3560d847 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/action" status: 202 len: 0 microversion: 2.20 time: 0.371375 Jun 28 17:53:22.584706 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 368/727] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 28 17:53:22 2022] POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:53:22.594604 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:22.595559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:22.606395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.606903 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.607932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:22.608432 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:22.791423 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:22.799699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:22.801550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:22.802924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a6977e8a-81cd-400d-af8d-49ec2d1d7922 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.216068 Jun 28 17:53:22.807770 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 360/728] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:22 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:53:23.823279 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:23.823993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:23.833289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:23.833746 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:23.834645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:23.835100 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:23.983092 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:23.993374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:23.995116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:23.996426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-afddb232-793b-420c-a35b-d37693de06bc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.178431 Jun 28 17:53:23.996995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 369/729] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:23 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:53:25.245951 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:25.246730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:25.253250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.253700 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.254540 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.254975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.397612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:25.406431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:25.408025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:25.409393 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-956b4e9b-928e-4de0-b3b0-d3e1d6c95333 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.396049 Jun 28 17:53:25.409971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 361/730] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:25 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:25.527026 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:25.527594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:25.536407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.536900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.537943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.538425 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.552547 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 HTTP/1.1 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:53:25.554315 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.555900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '4a96fab3-87dd-4823-bd8b-be1774e270d0'} Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:53:25.556846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.558293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.560432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:53:25.560432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f8bb1cb4-7487-43dd-8880-af09f5d919b2 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 404 len: 111 microversion: 2.1 time: 0.034055 Jun 28 17:53:25.560432 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 370/731] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:53:25 2022] DELETE /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:25.564731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:25.565348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 4a96fab3-87dd-4823-bd8b-be1774e270d0] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:25.572515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.572969 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.573752 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:25.574188 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:25.589501 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 HTTP/1.1 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:53:25.590619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.592225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '4a96fab3-87dd-4823-bd8b-be1774e270d0'} Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:53:25.593443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. Jun 28 17:53:25.594995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:25.596994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 4a96fab3-87dd-4823-bd8b-be1774e270d0 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:53:25.596994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d35728e2-4263-4f88-aaf3-6b6d31bd7ffb tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jun 28 17:53:25.596994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 362/732] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:25 2022] GET /compute/v2.1/servers/4a96fab3-87dd-4823-bd8b-be1774e270d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:26.429447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:26.430063 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:26.437183 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.437719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.438539 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.439058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.587083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:26.596089 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:26.597651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:26.598853 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-051b1cba-1769-430f-baaf-0218c97eda04 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.174084 Jun 28 17:53:26.599426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 371/733] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:26 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:26.764875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:26.765906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:26.783548 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.784416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.790343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.791232 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.821323 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc HTTP/1.1 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:53:26.823650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.825747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc'} Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:53:26.827177 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.828551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.830343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:53:26.830343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8bf3ca52-853c-4b05-b69d-bee0975a7c7f tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 404 len: 111 microversion: 2.1 time: 0.068559 Jun 28 17:53:26.830343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 363/734] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:53:26 2022] DELETE /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:26.837034 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:26.837750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] [instance: 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:26.846610 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.847174 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.848171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:26.848990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:26.857778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:26.875795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] HTTP exception thrown: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Request method failure captured: Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc HTTP/1.1 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz5y6p6EYzlXXZ0UyKbZdtYyQVpLOy839lQvXjkJ9-sSvPaPVbcNtuZ08d9Vu9YFjo8ClZZpPOn1iyE_dlBbTEakeFnQR1NelKvMGrEzp7vvQj2HpZp1qmBqVIujib3pB61lG3XfH29OrrHOz_vK7XvDBwkrcJu86LdVgCF7jKiLTT4 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:53:26.877505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f62aa1a154c498fbda7643ae9180098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f62aa1a154c498fbda7643ae9180098"}]}] Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 2f62aa1a154c498fbda7643ae9180098 Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1289355962 Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 77c37b0691e94ef784ee377e7ebfd6ef Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeTestJSON-1289355962-project Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.879076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc'} Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:53:26.879855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. Jun 28 17:53:26.881093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:53:26.882482 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] Returning 404 to user: Instance 9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:53:26.882482 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6a343d6f-aff8-4dbc-bf93-5782d201a9f5 tempest-AttachVolumeTestJSON-1289355962 tempest-AttachVolumeTestJSON-1289355962-project] 10.222.0.43 "GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc" status: 404 len: 111 microversion: 2.1 time: 0.050533 Jun 28 17:53:26.883334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 372/735] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:53:26 2022] GET /compute/v2.1/servers/9dd35ed9-b4a8-4614-9b6a-06b03f7e5ecc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:27.617762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:27.618492 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:27.625513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:27.626101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:27.627164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:27.627699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:27.844278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:27.852518 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:27.856329 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:27.858373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:27.859619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-67af356c-e5ea-4f56-a1e0-27f19915d0ee tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.246233 Jun 28 17:53:27.860204 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 364/736] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:27 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:28.890446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:28.894729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:28.912728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:28.913809 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:28.914856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:28.915479 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:29.241349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:29.250624 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:29.252551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:29.254008 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5f29dc3f-134d-4d16-9e86-a9b32a915cde tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.379522 Jun 28 17:53:29.255094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 373/737] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:28 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:30.274876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:30.275510 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:30.278202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:30.287039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:30.288157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:30.289012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:30.289451 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:30.772290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:30.786770 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:30.789315 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:30.791444 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-26755373-1d3b-4808-acee-dc79b44164fb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.521797 Jun 28 17:53:30.793508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 365/738] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:30 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:53:31.811616 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:31.813235 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:31.821745 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:31.822245 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:31.824676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:31.824676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:31.990349 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:32.006636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:32.009819 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:32.011069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-98d0a842-5f94-4cbf-aea8-e230f4472d2f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.203768 Jun 28 17:53:32.011851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 374/739] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:31 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:33.035740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:33.037905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:33.047324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:33.047846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:33.048723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:33.049308 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:33.322095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:33.333489 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:33.335463 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:33.336691 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9779c94e-d63c-41ff-ba3e-a01447cb42cc tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.309507 Jun 28 17:53:33.337589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 366/740] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:33 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:34.363078 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:34.364496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:34.375922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:34.377379 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:34.378658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:34.379301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:34.556107 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:34.569361 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:34.570975 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:34.572855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9443e102-7b68-455a-8222-f4d9cac8be55 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.220285 Jun 28 17:53:34.584184 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 375/741] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:34 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:35.592418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:35.593025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:35.602694 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:35.603425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:35.604621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:35.605659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:35.835924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:35.848839 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:35.850741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:35.852138 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-90825984-f9b0-4331-8ee8-32843c7bcebd tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.263858 Jun 28 17:53:35.852981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 367/742] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:35 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:36.872802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:36.873624 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:36.884287 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:36.890865 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:36.891504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:36.892884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:36.893410 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:37.063769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:37.072023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:37.073647 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:37.074892 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1c1dde16-cee1-445e-802f-815e3e535783 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.208282 Jun 28 17:53:37.075567 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 376/743] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:36 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:38.097331 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:38.097998 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:38.113307 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:38.113770 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:38.114571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:38.115013 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:38.410508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:38.421359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:38.430893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:38.432216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e1b305dc-15d2-4e10-b10d-04b8dadd1753 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1745 microversion: 2.20 time: 0.341966 Jun 28 17:53:38.447499 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 368/744] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:38 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1745 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:39.451920 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:39.453295 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:39.461093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:39.461835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:39.462932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:39.463523 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:40.226194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:40.252672 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:40.254778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:40.257255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3fecb7d3-9d57-4f1c-8cd8-c52026a388d5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1745 microversion: 2.20 time: 0.809223 Jun 28 17:53:40.258159 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 377/745] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:39 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1745 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:41.278482 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:41.279362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:41.307563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:41.308031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:41.309010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:41.309485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:41.746946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:41.767079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:41.776539 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:41.787543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c8cf2ef3-f1c8-4106-8b1a-44db3c88971e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.513583 Jun 28 17:53:41.793621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 369/746] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:41 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:42.810266 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:42.811599 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:42.829964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:42.830846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:42.832073 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:42.832779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:43.140593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:43.152654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:43.163656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:43.167327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d70394d3-02a8-4e91-a988-79952e10f171 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.361034 Jun 28 17:53:43.171229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 378/747] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:42 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:44.111042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-07018501-4582-4a29-bb27-ce005ffc0bc8 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Action: 'create', calling method: .version_select at 0x7f577206be50>, body: {"keypair": {"name": "tempest-TestShelveInstance-164806118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMDRSxEQQVCJNlnH7pxjTEZRium0Ey1mS0ZKgX76vMCiPaeQwxDZykK54kWK7LD1FNBxAvEssneHF6N2+7IdNhf9wwzVHzPlwv7JYELrQvQmer5IZBg24MKWW6VL9x3mw=="}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:44.152209 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-07018501-4582-4a29-bb27-ce005ffc0bc8 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Getting quotas for project 01df3376f07f4e38b6ad42b030711f72. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:53:44.157020 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-07018501-4582-4a29-bb27-ce005ffc0bc8 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Getting quotas for user 8021cab94c8545b2bb9b202b08ce5cc4 and project 01df3376f07f4e38b6ad42b030711f72. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:53:44.190635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:44.193209 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:44.195100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-07018501-4582-4a29-bb27-ce005ffc0bc8 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.400742 Jun 28 17:53:44.195746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 370/748] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:53:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:44.202202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:44.203816 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:44.205128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:44.211663 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:44.484167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:44.494353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:44.500599 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:44.508573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5fb8fd6f-cecf-4b2a-91d8-50de0ea997b4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.321959 Jun 28 17:53:44.526925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 379/749] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:44 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:44.576701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-accad7cc-4234-4edf-b311-ea1a7feba2d6 req-cd2b02c6-78bc-4dc3-be17-e70d0791308e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "name": "network-vif-plugged", "status": "completed", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:44.588902 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-accad7cc-4234-4edf-b311-ea1a7feba2d6 req-cd2b02c6-78bc-4dc3-be17-e70d0791308e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:44.589353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-accad7cc-4234-4edf-b311-ea1a7feba2d6 req-cd2b02c6-78bc-4dc3-be17-e70d0791308e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:44.612715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-accad7cc-4234-4edf-b311-ea1a7feba2d6 req-cd2b02c6-78bc-4dc3-be17-e70d0791308e service nova] Creating event network-vif-plugged:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:53:44.627332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-accad7cc-4234-4edf-b311-ea1a7feba2d6 req-cd2b02c6-78bc-4dc3-be17-e70d0791308e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054250 Jun 28 17:53:44.632180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 371/750] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:45.535206 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:45.536050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:45.554838 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:45.556578 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:45.557729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:45.561270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:45.813123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:45.833085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:45.842244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:45.843629 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0151a1c2-accc-4624-a9e1-e3a9a63ccea4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.313580 Jun 28 17:53:45.846803 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 380/751] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:45 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:46.867096 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:46.868630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:46.878687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:46.879769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:46.881051 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:46.882381 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:47.108636 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:47.142403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:47.144293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:47.151122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9e623348-ac0d-4fa6-8b4a-46b3e8a04626 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.286943 Jun 28 17:53:47.166042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 372/752] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:46 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:48.174244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:48.174972 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:48.187376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:48.188098 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:48.193633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:48.196431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:48.450922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:48.470490 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:48.473401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:48.474941 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-42db8860-2c2c-42f3-814f-4a65d5e68a9b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.305949 Jun 28 17:53:48.486882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 381/753] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:48 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:49.494826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:49.496125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:49.510399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:49.512970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:49.516295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:49.517581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:49.856257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:49.866746 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:49.868662 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:49.869881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0c676583-43c6-4abe-9bbe-29b73155c91b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.379921 Jun 28 17:53:49.870638 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 373/754] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:49 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:50.893244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:50.895564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:50.903339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:50.904258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:50.905976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:50.906718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:51.118659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:51.132996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:51.134693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:51.136350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8651e021-e408-4a15-9d2a-9b0f3434daf2 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.251489 Jun 28 17:53:51.147655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 382/755] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:50 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:52.160140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:52.160952 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:52.170791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:52.171410 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:52.172274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:52.172935 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:52.424327 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:52.435724 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:52.437669 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:52.439131 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e4916370-438c-4eab-9bf8-f4c42dd17897 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.286907 Jun 28 17:53:52.439774 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 374/756] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:52 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:53:53.459710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:53.460339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:53.474440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:53.474927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:53.475726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:53.476168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:53.679911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:53.699475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:53.701216 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:53.703732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3ac218d0-e687-45fe-865a-b96f1e9f69b6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.249235 Jun 28 17:53:53.704719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 383/757] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:53 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:54.723846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:54.725056 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:54.728825 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:54.744808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:54.745294 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:54.746092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:54.746530 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:54.935046 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:54.944817 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:54.946557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:54.947745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-07169a0c-8237-4242-b4fb-1dd532dbe1d4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1740 microversion: 2.20 time: 0.228731 Jun 28 17:53:54.948311 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 375/758] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:54 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:55.969734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:55.970801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:55.981916 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:55.985174 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:55.988927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:55.989573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:56.252422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:56.262059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:56.263671 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:56.264941 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-847d75a0-ac6b-4094-a13c-7fb0c28e86ca tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1722 microversion: 2.20 time: 0.301053 Jun 28 17:53:56.265539 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 384/759] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:55 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:53:57.287748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:57.289023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:57.300332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:57.300953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:57.301974 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:57.302481 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:57.547183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:57.560649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:57.563570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:57.566625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ff92ad18-4490-4c0b-a18b-c39a9d9315a4 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1722 microversion: 2.20 time: 0.284009 Jun 28 17:53:57.567911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 376/760] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:57 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:58.544116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-9b907079-a6dc-44da-9fd6-f0ed1d9a65be req-91576181-6ab6-492a-91bb-c94a57902667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "name": "network-vif-unplugged", "status": "completed", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:58.557995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-9b907079-a6dc-44da-9fd6-f0ed1d9a65be req-91576181-6ab6-492a-91bb-c94a57902667 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:58.558450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-9b907079-a6dc-44da-9fd6-f0ed1d9a65be req-91576181-6ab6-492a-91bb-c94a57902667 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:58.586780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-9b907079-a6dc-44da-9fd6-f0ed1d9a65be req-91576181-6ab6-492a-91bb-c94a57902667 service nova] Creating event network-vif-unplugged:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:53:58.598938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:58.601077 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:58.601431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-9b907079-a6dc-44da-9fd6-f0ed1d9a65be req-91576181-6ab6-492a-91bb-c94a57902667 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063974 Jun 28 17:53:58.602912 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 385/761] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:53:58.631680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:58.632285 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:58.633706 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:58.634301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:58.822923 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:58.832741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:58.834510 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:53:58.835749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-67fd956e-88e5-4d9d-a9dc-0b519c559de9 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1725 microversion: 2.20 time: 0.244616 Jun 28 17:53:58.836335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 377/762] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:53:58 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:53:58.855408 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33e8d92a-bebe-4e5f-a252-eec74f8e2b35"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:58.858189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:58.866113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:58.866655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:58.867411 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:58.867844 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:58.993112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=79 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:59.285994 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-10a398dd-32ba-4fa9-b142-4ef459652218 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.435301 Jun 28 17:53:59.287566 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 386/763] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Jun 28 17:53:58 2022] POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments => generated 188 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 17:53:59.473187 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:53:59.473682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:59.481590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:59.482126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:59.483044 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:59.483498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:59.810953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fdd1c221-db8b-4254-969a-35ceb08772b5 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments/33e8d92a-bebe-4e5f-a252-eec74f8e2b35" status: 202 len: 0 microversion: 2.20 time: 0.342097 Jun 28 17:53:59.815121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 378/764] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Jun 28 17:53:59 2022] DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments/33e8d92a-bebe-4e5f-a252-eec74f8e2b35 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:53:59.900329 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:53:59.901335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:53:59.911967 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:59.912711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:53:59.914366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:53:59.914930 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:00.024417 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0cb0d6cb-d276-4989-a644-0fa7380b52c6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/action" status: 202 len: 0 microversion: 2.20 time: 0.130511 Jun 28 17:54:00.025416 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 387/765] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 28 17:53:59 2022] POST /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:54:00.036137 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:00.037269 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:00.050993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:00.051701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:00.053117 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:00.053744 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:00.238185 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:00.254828 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:00.256491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:00.258468 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0ee17246-6ce6-4ba3-b4fb-5a6d63a97c48 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1673 microversion: 2.20 time: 0.227172 Jun 28 17:54:00.259433 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 379/766] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:00 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:01.283534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:01.285573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:01.301353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:01.302059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:01.303872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:01.304704 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:01.464086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:01.473028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:01.474533 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:01.475715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d01d1f60-2a8c-41bf-9c5d-e4edcf522e6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.200518 Jun 28 17:54:01.476469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 388/767] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:01 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:01.918233 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2098871624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-164806118", "security_groups": [{"name": "tempest-secgroup-smoke-1742348423"}], "networks": [{"uuid": "a686f13f-2eb7-476c-b004-7d84edb8ea06"}], "block_device_mapping_v2": [{"uuid": "bf032a7a-ec6e-47f9-b15f-4553b8d9e090", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:01.930408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:02.106704 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] validate_networks() for [('a686f13f-2eb7-476c-b004-7d84edb8ea06', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:54:02.512602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:02.513513 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:02.523505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:02.524730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:02.525992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:02.526658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:02.841366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:02.855968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:02.860220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:02.862477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-302fd90f-e626-4c8c-aa8c-6fcb18919b5f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.365205 Jun 28 17:54:02.864331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 389/768] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:02 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:54:02.924527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:54:02.925356 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:54:02.925489 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:54:02.926185 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:54:02.926955 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:54:02.943944 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:02.944808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:02.945984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:02.946631 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:02.961881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:02.979049 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Getting quotas for project 01df3376f07f4e38b6ad42b030711f72. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:54:02.986191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Getting quotas for user 8021cab94c8545b2bb9b202b08ce5cc4 and project 01df3376f07f4e38b6ad42b030711f72. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:54:03.114993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:54:03.115576 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf032a7a-ec6e-47f9-b15f-4553b8d9e090',volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:54:03.431239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-da06994f-7300-4469-803f-46e27532a191 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.519780 Jun 28 17:54:03.439225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 380/769] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:54:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:54:03.462290 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bfaaf4c1-dab7-46e6-b3ad-ddb5d2573bc4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:03.466666 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bfaaf4c1-dab7-46e6-b3ad-ddb5d2573bc4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:03.588125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-bfaaf4c1-dab7-46e6-b3ad-ddb5d2573bc4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:03.606368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bfaaf4c1-dab7-46e6-b3ad-ddb5d2573bc4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1088 microversion: 2.1 time: 0.155946 Jun 28 17:54:03.608705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 390/770] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:03 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1088 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:03.886754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:03.887768 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:03.913110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:03.915603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:03.917060 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:03.917809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:04.286551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:04.311155 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:04.315328 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:04.317248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7abaeceb-7d05-423a-8b8d-b658e153ad73 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.437212 Jun 28 17:54:04.318366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 381/771] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:03 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:04.709484 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:04.710614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:04.729656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:04.730748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:04.732053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:04.733168 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:04.837588 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:04.848771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a445ad5f-daae-4798-a3c6-d6daea80d848 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.145569 Jun 28 17:54:04.849842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 391/772] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:04 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:05.346020 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:05.346932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:05.357841 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:05.358289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:05.359176 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:05.359995 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:05.567171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:05.579684 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:05.581714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:05.583321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f0a6fc0f-cad0-47f7-a6f7-c3b9a037820c tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.242938 Jun 28 17:54:05.584485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 382/773] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:05 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:05.880499 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:05.882366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:05.898362 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:05.899495 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:05.900976 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:05.901577 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:06.011319 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:06.026313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9ded5e76-75ed-4b18-a1eb-349cfa4fcf19 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.151127 Jun 28 17:54:06.028750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 392/774] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:05 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:06.614126 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:06.614892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:06.622879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:06.624023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:06.625943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:06.626852 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:06.846837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:06.862263 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:06.865866 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:06.868360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3c44cb44-dc57-40ef-bc79-78482b25ff10 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.259840 Jun 28 17:54:06.870289 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 383/775] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:06 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:07.046543 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:07.047353 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:07.050055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=38 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:07.063922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:07.065852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:07.068124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:07.068845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:07.147438 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:07.159041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-364872c6-fac4-46d8-ad6d-f4148aa7ae08 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.116441 Jun 28 17:54:07.160531 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 393/776] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:07 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:07.901340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:07.903404 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:07.914384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:07.915725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:07.916850 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:07.917626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:08.155239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:08.173970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:08.177589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:08.191667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:08.194230 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:08.197322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5cae55cc-681d-4214-87c8-a37b2044fea1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.286524 Jun 28 17:54:08.201511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 384/777] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:07 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:08.214539 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:08.216072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:08.217974 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:08.219126 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:08.353881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:08.363182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-66a08d06-e917-4eac-90be-95d3a6e330f2 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.181061 Jun 28 17:54:08.364240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 394/778] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:08 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:09.226395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:09.228134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:09.242709 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:09.243517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:09.253212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:09.255255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:09.388444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:09.388444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:09.402989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:09.403435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:09.412614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:09.413735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:09.613876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:09.659290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:09.664065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:09.665619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c48ee503-cdda-4ccc-82b9-676b4fe6f01e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.446577 Jun 28 17:54:09.666219 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 385/779] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:09 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:09.890079 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:09.899814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ef153d2d-7587-4bda-85ae-62fda09fa29e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.522349 Jun 28 17:54:09.913462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 395/780] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:09 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:10.685467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:10.686085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:10.692879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:10.693324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:10.694101 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:10.694594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:10.834882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:10.843519 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:10.845085 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:10.846750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-15ed3fc8-5b3e-4be5-85e7-b46df960163b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.164929 Jun 28 17:54:10.848359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 386/781] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:10 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:10.918665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:10.919377 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:10.927814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:10.928442 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:10.929721 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:10.930157 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:10.994176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:11.002104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b866b6f6-89da-4d09-bf47-ab1d1e484c38 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1138 microversion: 2.1 time: 0.088670 Jun 28 17:54:11.002972 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 396/782] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:10 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:11.867181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:11.867809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:11.876496 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:11.876824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:11.877810 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:11.878287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:12.019095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:12.019693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:12.027670 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:12.028122 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:12.028939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:12.029376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:12.049329 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:12.058427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:12.060362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:12.061602 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a5b2ab9e-d923-4dff-acab-9a1b9d45fbf3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.200228 Jun 28 17:54:12.068692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 387/783] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:11 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:12.100720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:12.110108 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cfcaaa18-e562-4e4a-9845-75ce1929af97 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1186 microversion: 2.1 time: 0.095199 Jun 28 17:54:12.111001 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 397/784] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:12 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:13.081759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:13.082585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:13.088728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:13.089483 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:13.091769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:13.092210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:13.093130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:13.093578 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:13.135662 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:13.137559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:13.157309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:13.158779 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:13.160835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:13.161768 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:13.462967 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:13.478082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:13.489421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:13.493358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:13.496316 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1e9d6015-1bac-410c-855c-622741e2fca4 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1272 microversion: 2.1 time: 0.371011 Jun 28 17:54:13.497246 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e3b637a3-0b03-4beb-b2b1-6f2f94295f0a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.418800 Jun 28 17:54:13.498868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 388/785] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:13 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 17:54:13.500876 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 398/786] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:13 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:14.297379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-910511b7-5f49-4e65-8453-3ec0305753fe req-ea7adc5d-e38e-4b2b-8ac5-fd7df249cfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:14.312747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-910511b7-5f49-4e65-8453-3ec0305753fe req-ea7adc5d-e38e-4b2b-8ac5-fd7df249cfa5 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.313628 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-910511b7-5f49-4e65-8453-3ec0305753fe req-ea7adc5d-e38e-4b2b-8ac5-fd7df249cfa5 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.331799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-910511b7-5f49-4e65-8453-3ec0305753fe req-ea7adc5d-e38e-4b2b-8ac5-fd7df249cfa5 service nova] Creating event network-changed:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:54:14.338642 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-910511b7-5f49-4e65-8453-3ec0305753fe req-ea7adc5d-e38e-4b2b-8ac5-fd7df249cfa5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045487 Jun 28 17:54:14.339260 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 389/787] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:14.522751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:14.523648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:14.527186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:14.528002 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:14.534525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:14.539674 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.540123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.550148 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.550844 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.560808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.560808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.566507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.567009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.802484 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:14.819434 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:14.823277 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:14.826867 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a375f767-880f-4b8f-8c39-daac35c053f1 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.312051 Jun 28 17:54:14.830261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 399/788] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:14 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:14.854120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-c02d1ad8-17cf-422a-945a-f1202ec6eec8 req-6d885b82-0ac4-4677-9e7a-f84d5e8e9dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "name": "network-vif-plugged", "status": "completed", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:14.867419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-c02d1ad8-17cf-422a-945a-f1202ec6eec8 req-6d885b82-0ac4-4677-9e7a-f84d5e8e9dc5 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:14.868167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-c02d1ad8-17cf-422a-945a-f1202ec6eec8 req-6d885b82-0ac4-4677-9e7a-f84d5e8e9dc5 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:14.881724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-c02d1ad8-17cf-422a-945a-f1202ec6eec8 req-6d885b82-0ac4-4677-9e7a-f84d5e8e9dc5 service nova] Creating event network-vif-plugged:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:54:14.888959 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-c02d1ad8-17cf-422a-945a-f1202ec6eec8 req-6d885b82-0ac4-4677-9e7a-f84d5e8e9dc5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042738 Jun 28 17:54:14.890087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 400/789] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:14.956652 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:14.990399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d18cbcb0-55bc-45b8-833e-97c010bfb83b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.472280 Jun 28 17:54:14.991799 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 390/790] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:14 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:15.857325 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:15.858541 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:15.865763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:15.866305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:15.867100 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:15.867537 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:15.883077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:15.949005 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2123463287", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:16.002767 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] validate_networks() for None {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:54:16.007828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:16.017007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:16.018534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:16.019702 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6f8c3eca-312e-47da-8c13-78276f668b6a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.168031 Jun 28 17:54:16.020472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 401/791] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:15 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:16.027982 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:16.028688 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:16.035409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:16.035776 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:16.036608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:16.037072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:16.271960 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:16.280821 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-673c033c-7513-496b-8ab8-5470967b6a84 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.256127 Jun 28 17:54:16.281409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 402/792] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:16 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:16.301598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:54:16.302018 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:54:16.302485 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:54:16.302887 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:54:16.303293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:54:16.313592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:16.314071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:16.314862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:16.315296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:16.332918 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Getting quotas for project 979f958b515b42369705aee8defb619b. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:54:16.337153 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Getting quotas for user 21a45aa99d70429baad760725eade490 and project 979f958b515b42369705aee8defb619b. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:54:16.349252 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:54:16.351998 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:54:16.401674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-440f47ef-a7e6-47b4-9c51-162f3a1630ce tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457268 Jun 28 17:54:16.402239 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 391/793] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 17:54:16.412453 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-58e8425c-6dea-463c-a3e4-cf429efc3546 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:16.413171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-58e8425c-6dea-463c-a3e4-cf429efc3546 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:16.468661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-58e8425c-6dea-463c-a3e4-cf429efc3546 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:16.475433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-58e8425c-6dea-463c-a3e4-cf429efc3546 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1215 microversion: 2.1 time: 0.066823 Jun 28 17:54:16.476171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 403/794] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:16 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:17.040684 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:17.042157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:17.059454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.060411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.062425 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.064709 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.258081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:17.268257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:17.269898 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:17.271187 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d728fffc-7fe4-4f4d-892f-439beb03ff93 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1731 microversion: 2.20 time: 0.234893 Jun 28 17:54:17.271829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 392/795] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:17 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:17.297210 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:17.297817 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:17.305794 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.306240 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.307010 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.307439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.481885 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:17.490006 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d2817784-d911-4a16-adb7-79e8c76aad44 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.196573 Jun 28 17:54:17.490558 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 404/796] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:17 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:17.495448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:17.496465 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:17.505493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.506012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.506827 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:17.508720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:17.603791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:17.617229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-58044776-cedf-4b55-9da2-3de703fd97dc tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1267 microversion: 2.1 time: 0.126633 Jun 28 17:54:17.618692 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 393/797] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:17 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:18.290777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:18.291394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:18.297850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.298553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.299774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.300242 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.487306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:18.497590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:18.499193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:18.502489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4265ae88-5a86-4986-8963-e77dc35c753a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1718 microversion: 2.20 time: 0.214790 Jun 28 17:54:18.502489 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 405/798] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:18 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:18.514058 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:18.515152 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:18.525471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.526104 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.527029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.527593 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.636072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:18.636645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:18.644929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.645387 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.646214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:18.646832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:18.680080 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:18.689748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-44297962-08e0-4ad5-9e09-3ac954bd9b81 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.185365 Jun 28 17:54:18.690429 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 394/799] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:18 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:18.723313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:18.732203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6e78fdce-9af7-41aa-b6c1-92694478c279 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1273 microversion: 2.1 time: 0.100653 Jun 28 17:54:18.732839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 406/800] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:18 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:19.707386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:19.708925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:19.721271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:19.721720 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:19.722513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:19.722983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:19.753466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:19.754266 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:19.762194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:19.762655 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:19.763493 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:19.763960 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:19.935277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:19.950756 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c72386a3-eba7-4592-9c6c-bd13839a432d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.247293 Jun 28 17:54:19.952487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 395/801] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:19 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:19.956610 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-eb0ba42c-eefd-43e2-b4df-17f3a95c163c req-d7e5ec5c-197a-4cfa-8c2b-eced5e0662d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f893c56a-c4ef-49f6-b81e-f1e1f967bf54", "tag": "df33b1f4-4891-499e-af28-1866f2ab418e"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:19.969548 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-eb0ba42c-eefd-43e2-b4df-17f3a95c163c req-d7e5ec5c-197a-4cfa-8c2b-eced5e0662d4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:19.970190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-eb0ba42c-eefd-43e2-b4df-17f3a95c163c req-d7e5ec5c-197a-4cfa-8c2b-eced5e0662d4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:19.986108 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-eb0ba42c-eefd-43e2-b4df-17f3a95c163c req-d7e5ec5c-197a-4cfa-8c2b-eced5e0662d4 service nova] Creating event network-changed:df33b1f4-4891-499e-af28-1866f2ab418e for instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 on hv-cinder-84801 Jun 28 17:54:19.992841 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-eb0ba42c-eefd-43e2-b4df-17f3a95c163c req-d7e5ec5c-197a-4cfa-8c2b-eced5e0662d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038335 Jun 28 17:54:19.996484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 396/802] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:20.012612 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:20.022238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-14a2afb8-9ed2-4446-a829-7d896124d050 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.274606 Jun 28 17:54:20.023975 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 407/803] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:19 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:20.968707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:20.969407 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:20.977498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:20.977938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:20.978767 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:20.979195 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:21.041571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:21.042160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:21.050028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:21.050468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:21.051244 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:21.051691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:21.168914 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:21.177241 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8ff32799-9b95-4098-a818-502c7cdb0d2c tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.213188 Jun 28 17:54:21.177905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 397/804] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:20 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:21.221724 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:21.230095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e8241db7-bc06-4c85-af96-9182df773f8b tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.193515 Jun 28 17:54:21.230690 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 408/805] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:21 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:22.195629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:22.196363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:22.203931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:22.204373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:22.205438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:22.205876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:22.247887 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:22.249358 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:22.256372 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:22.257044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:22.257927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:22.258470 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:22.386711 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:22.396864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-52f9fbaa-5286-466d-993d-a8fe670b97d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.205216 Jun 28 17:54:22.397528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 398/806] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:22 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:22.453638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:22.470880 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f89efc31-0116-4887-b0de-d397d170d41d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.227393 Jun 28 17:54:22.471475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 409/807] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:22 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:23.414277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:23.414983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:23.422272 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:23.422602 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:23.423413 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:23.423844 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:23.440580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=100 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:23.488769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:23.489593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:23.496864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:23.497323 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:23.498110 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:23.498530 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:23.581449 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:23.590513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-85c910f8-e55f-4aeb-8383-7c7ec7e8b22e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.180216 Jun 28 17:54:23.591401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 399/808] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:23 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:23.684215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:23.693393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-da227276-7601-46f1-a5f5-52b4b70b9558 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.208406 Jun 28 17:54:23.694386 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 410/809] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:23 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:24.608096 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:24.608762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:24.615905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:24.616493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:24.617278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:24.617718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:24.719355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:24.719968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:24.727202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:24.727650 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:24.728452 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:24.728911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:24.758654 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:24.768314 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7a8abe28-3579-4ee3-aacf-3dc09dcf353a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.164039 Jun 28 17:54:24.769299 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 400/810] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:24 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:24.889429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:24.897999 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7c769880-b76a-487c-aec4-50ee9ac4e78d tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.182487 Jun 28 17:54:24.907654 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 411/811] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:24 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:25.083050 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-880d8ab5-eba9-4c4f-8c6c-caa262c3129e req-92a05b80-beb4-43fa-9987-c176dbcad72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "name": "network-vif-plugged", "status": "completed", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:25.096284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-880d8ab5-eba9-4c4f-8c6c-caa262c3129e req-92a05b80-beb4-43fa-9987-c176dbcad72c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:25.097062 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-880d8ab5-eba9-4c4f-8c6c-caa262c3129e req-92a05b80-beb4-43fa-9987-c176dbcad72c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:25.116142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-880d8ab5-eba9-4c4f-8c6c-caa262c3129e req-92a05b80-beb4-43fa-9987-c176dbcad72c service nova] Creating event network-vif-plugged:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:54:25.124095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-880d8ab5-eba9-4c4f-8c6c-caa262c3129e req-92a05b80-beb4-43fa-9987-c176dbcad72c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046311 Jun 28 17:54:25.125274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 401/812] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:25.788886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:25.789846 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:25.797056 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:25.797511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:25.798285 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:25.798718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:25.920801 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:25.921722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:25.930846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:25.931149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:25.931965 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:25.932432 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:25.975020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:25.984735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e58bcd98-96fb-4b7a-b218-a9f5ecf4d0a3 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.203182 Jun 28 17:54:25.985339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 412/813] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:25 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:26.094729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:26.103125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-57851697-6943-49a4-a847-98212d984d87 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.190972 Jun 28 17:54:26.103725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 402/814] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:25 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:27.003594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:27.004486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:27.006335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:27.013483 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:27.013928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:27.014733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:27.015167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:27.123645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:27.125814 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:27.129533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:27.130821 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:27.144045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:27.145408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:27.146273 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:27.147027 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:27.193973 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:27.208200 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-33ba0dd9-e166-43a2-b4a2-a49585aace3b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1260 microversion: 2.1 time: 0.208244 Jun 28 17:54:27.209554 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 413/815] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:26 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:27.218113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-0acd03fd-afa7-4f30-8b48-740d13b84142 req-73732392-7b25-49cf-8b4f-46870f750c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893c56a-c4ef-49f6-b81e-f1e1f967bf54", "name": "network-vif-plugged", "status": "completed", "tag": "df33b1f4-4891-499e-af28-1866f2ab418e"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:27.227853 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-0acd03fd-afa7-4f30-8b48-740d13b84142 req-73732392-7b25-49cf-8b4f-46870f750c80 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:27.228301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-0acd03fd-afa7-4f30-8b48-740d13b84142 req-73732392-7b25-49cf-8b4f-46870f750c80 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:27.240958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-0acd03fd-afa7-4f30-8b48-740d13b84142 req-73732392-7b25-49cf-8b4f-46870f750c80 service nova] Creating event network-vif-plugged:df33b1f4-4891-499e-af28-1866f2ab418e for instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 on hv-cinder-84801 Jun 28 17:54:27.247825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-0acd03fd-afa7-4f30-8b48-740d13b84142 req-73732392-7b25-49cf-8b4f-46870f750c80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Jun 28 17:54:27.248948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 414/816] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:27.317568 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:27.328940 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-320f0f2d-e5a3-44f2-81d5-260049d3532c tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.212072 Jun 28 17:54:27.329829 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 403/817] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:27 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:28.237002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:28.237818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:28.245384 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.245828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.246670 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.247085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.357792 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:28.358877 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:28.370104 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.370882 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.372307 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.373130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.437147 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:28.445862 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dbf138ca-b2fb-495b-bcfd-1264e700614f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1445 microversion: 2.1 time: 0.213938 Jun 28 17:54:28.446570 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 415/818] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:28 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1445 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:28.463464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:28.464212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:28.471515 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.471870 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.472986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:28.473443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:28.587797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:28.599073 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1272692e-69f3-42b2-aa17-4f9c60865779 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1315 microversion: 2.1 time: 0.249161 Jun 28 17:54:28.600145 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 404/819] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:28 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:28.663080 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:28.672643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-388c5939-bcf5-4cfd-a247-d2f1a1873098 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1445 microversion: 2.1 time: 0.213276 Jun 28 17:54:28.673237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 416/820] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:28 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1445 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:29.624481 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:29.625088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:29.632475 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:29.633247 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:29.634675 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:29.635436 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:29.824991 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:29.838253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-655afa7e-9160-4e53-8b6a-c52d36ba438e tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1465 microversion: 2.1 time: 0.217932 Jun 28 17:54:29.839629 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 405/821] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:29 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:29.904874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:29.905456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:29.913366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:29.914383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:29.915597 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:29.917656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:29.949508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:54:30.062736 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-46862c97-5960-41b3-80b9-835fce6420f0 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 204 len: 0 microversion: 2.1 time: 0.161513 Jun 28 17:54:30.065437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 417/822] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:54:29 2022] DELETE /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:54:30.073976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:30.074659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:30.082180 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:30.082644 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:30.083467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:30.083908 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:30.265142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:30.273778 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2bd10ac2-609d-4e76-8256-3ac2e34e0d45 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1471 microversion: 2.1 time: 0.203813 Jun 28 17:54:30.274372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 406/823] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:30 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:31.150032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-73fe394d-d5fb-4230-b4ea-17703a1c8470 req-7f2b3fc9-22d8-426f-8b46-2e828abdf971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:31.159853 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-73fe394d-d5fb-4230-b4ea-17703a1c8470 req-7f2b3fc9-22d8-426f-8b46-2e828abdf971 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:31.160294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-73fe394d-d5fb-4230-b4ea-17703a1c8470 req-7f2b3fc9-22d8-426f-8b46-2e828abdf971 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:31.163514 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:31.174437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-73fe394d-d5fb-4230-b4ea-17703a1c8470 req-7f2b3fc9-22d8-426f-8b46-2e828abdf971 service nova] Creating event network-changed:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:54:31.179872 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-73fe394d-d5fb-4230-b4ea-17703a1c8470 req-7f2b3fc9-22d8-426f-8b46-2e828abdf971 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Jun 28 17:54:31.180796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 418/824] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:31.326466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:31.327637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:31.368896 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:31.369521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:31.370380 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:31.370830 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:31.621751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:31.636985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-38067691-8899-48bc-b269-99b13b170442 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1471 microversion: 2.1 time: 0.340096 Jun 28 17:54:31.638034 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 407/825] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:31 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:32.666052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:32.667670 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:32.677504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:32.678060 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:32.679094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:32.679738 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:32.763535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:32.777099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f10f5f43-37e5-44b5-8707-c84e01a58c69 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1429 microversion: 2.1 time: 0.118376 Jun 28 17:54:32.778985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 419/826] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:32 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:33.205815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-d355e1a9-5f75-4ccc-b1f0-bcc66494a007 req-a5930d16-40d1-495c-afe4-f7fdcbd1fa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893c56a-c4ef-49f6-b81e-f1e1f967bf54", "name": "network-vif-deleted", "tag": "df33b1f4-4891-499e-af28-1866f2ab418e"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:33.211024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:33.219587 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-d355e1a9-5f75-4ccc-b1f0-bcc66494a007 req-a5930d16-40d1-495c-afe4-f7fdcbd1fa05 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:33.220040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-d355e1a9-5f75-4ccc-b1f0-bcc66494a007 req-a5930d16-40d1-495c-afe4-f7fdcbd1fa05 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:33.233913 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-d355e1a9-5f75-4ccc-b1f0-bcc66494a007 req-a5930d16-40d1-495c-afe4-f7fdcbd1fa05 service nova] Creating event network-vif-deleted:df33b1f4-4891-499e-af28-1866f2ab418e for instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 on hv-cinder-84801 Jun 28 17:54:33.239403 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-d355e1a9-5f75-4ccc-b1f0-bcc66494a007 req-a5930d16-40d1-495c-afe4-f7fdcbd1fa05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047348 Jun 28 17:54:33.239971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 408/827] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:33.806437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:33.807451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:33.820746 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:33.821808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:33.823270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:33.824075 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:33.884111 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:33.884609 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:33.885081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lazy-loading 'fault' on Instance uuid f893c56a-c4ef-49f6-b81e-f1e1f967bf54 {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:54:33.942167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a45aa99d70429baad760725eade490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979f958b515b42369705aee8defb619b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:33.951469 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dd45bdd1-8efb-41fa-8240-225bde09b714 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 200 len: 1305 microversion: 2.1 time: 0.153116 Jun 28 17:54:33.952094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 420/828] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:33 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:54:34.970987 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:34.971723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] [instance: f893c56a-c4ef-49f6-b81e-f1e1f967bf54] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:34.979143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:34.979627 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:34.980406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:34.980858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:34.995002 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] HTTP exception thrown: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Request method failure captured: Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 HTTP/1.1 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0BGA8Mq2mbzrEXLwGKxgUIUCo_sB1K7ODakMgeRGxPYErI_i6rySLfALsPBKO7VSmS6J8wTQbrGN--F7P7LspQDLPvaIgbR6y43xTLHLPB2AviGLQ1OT4QqfMTx01Bzg4WNZkKoqAlCW1EinSwCKdozm33ZuazFLKLmfbf9XTi6fE0 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 979f958b515b42369705aee8defb619b Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-VolumesNegativeTest-620024603 Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:54:34.996722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979f958b515b42369705aee8defb619b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_979f958b515b42369705aee8defb619b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/979f958b515b42369705aee8defb619b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/979f958b515b42369705aee8defb619b"}]}] Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-VolumesNegativeTest-620024603 Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 979f958b515b42369705aee8defb619b Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-VolumesNegativeTest-620024603 Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-VolumesNegativeTest-620024603-project Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 21a45aa99d70429baad760725eade490 Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-VolumesNegativeTest-620024603-project Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. Jun 28 17:54:34.998257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'f893c56a-c4ef-49f6-b81e-f1e1f967bf54'} Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:34.999305 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. Jun 28 17:54:35.000943 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:35.002298 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] Returning 404 to user: Instance f893c56a-c4ef-49f6-b81e-f1e1f967bf54 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:35.002298 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ca930fdc-14bc-4908-a2ac-c3842f277bb4 tempest-VolumesNegativeTest-620024603 tempest-VolumesNegativeTest-620024603-project] 10.222.0.43 "GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54" status: 404 len: 111 microversion: 2.1 time: 0.031533 Jun 28 17:54:35.002298 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 409/829] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:54:34 2022] GET /compute/v2.1/servers/f893c56a-c4ef-49f6-b81e-f1e1f967bf54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:54:49.876676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:49.878404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=15 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:50.075339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d9b0204f-8a23-43c6-a717-8cc62f89bde7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Action: 'create', calling method: .version_select at 0x7f5771ede4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-226535126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd9lnsW3HKRPOpNIl3CCJJzyMvJ927dtupTPzjAhKkv7vrGpxDe5AzxvjRNwqoQGN6BUwtc5MCOycfiHw93hsNjb3SZOShnwf71Bj5cui7xxTVugMPI+dsADxVf7v2hdA=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:50.090834 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-d9b0204f-8a23-43c6-a717-8cc62f89bde7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for project 8a44949af40746b4af7f2acd60b73cba. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:54:50.095266 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-d9b0204f-8a23-43c6-a717-8cc62f89bde7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for user 03f29e8a281f4a2ab15342314d6968d3 and project 8a44949af40746b4af7f2acd60b73cba. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:54:50.121408 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d9b0204f-8a23-43c6-a717-8cc62f89bde7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.250567 Jun 28 17:54:50.122015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 421/830] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:54:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:54:51.537797 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:51.539411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:51.548162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:51.549149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=51 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:51.551110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.552068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.552984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.553423 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.597784 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7872ddf5-b538-41cc-a726-fc2aa682f03e tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064914 Jun 28 17:54:51.598927 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 410/831] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 28 17:54:51 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:54:51.661350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:51.661947 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:51.669189 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.669804 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.670579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.671009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.698761 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:54:51.788850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-78769bb8-e76a-45a7-8a2b-0a83fb4eb52a tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 204 len: 0 microversion: 2.20 time: 0.130887 Jun 28 17:54:51.793765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 422/832] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 28 17:54:51 2022] DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 17:54:51.801569 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:51.802552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:51.811349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.812335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.813648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:51.814250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:51.962003 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:51.970075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:51.971662 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:51.972783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-30449253-e88d-4991-b441-e841b605b619 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.177563 Jun 28 17:54:51.973350 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 411/833] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:51 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:52.997740 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:52.998423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:53.005186 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:53.005643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:53.006422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:53.006855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:53.170563 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:53.180243 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:53.181719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:53.182900 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d425bc62-c432-4fd6-bc5c-c1d55d3195d6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1724 microversion: 2.20 time: 0.192001 Jun 28 17:54:53.183487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 423/834] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:52 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:54.200905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:54.201471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:54.208394 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:54.208968 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:54.209764 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:54.210175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:54.309729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:54.318304 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:54.319940 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a63dee5a6194467a325c9499cd89bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617c65d2596b4cce9db8ef1806b98460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:54:54.321182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-85503fc5-e74b-4bae-85ae-6fface0dc4a6 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 200 len: 1657 microversion: 2.20 time: 0.124518 Jun 28 17:54:54.331660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 412/835] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:54 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 1657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 17:54:54.375827 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-204dd574-4408-4b85-b493-d22e568d21c9 req-5b3236de-c968-4b02-af00-4d928d87a4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29a2a9-c5c7-495e-b14a-ac464d76f97f", "name": "network-vif-deleted", "tag": "3cab7997-709b-4cb6-aef6-6e940b78bcc3"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:54:54.388009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-204dd574-4408-4b85-b493-d22e568d21c9 req-5b3236de-c968-4b02-af00-4d928d87a4a9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:54.388511 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-204dd574-4408-4b85-b493-d22e568d21c9 req-5b3236de-c968-4b02-af00-4d928d87a4a9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:54.401089 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-204dd574-4408-4b85-b493-d22e568d21c9 req-5b3236de-c968-4b02-af00-4d928d87a4a9 service nova] Creating event network-vif-deleted:3cab7997-709b-4cb6-aef6-6e940b78bcc3 for instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f on hv-cinder-84801 Jun 28 17:54:54.405955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-204dd574-4408-4b85-b493-d22e568d21c9 req-5b3236de-c968-4b02-af00-4d928d87a4a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Jun 28 17:54:54.409819 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 424/836] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:54:55.339550 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:55.340276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:55.347366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:55.347905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:55.348798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:55.349295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:55.366638 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f HTTP/1.1 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:54:55.368212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:55.369999 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '5f29a2a9-c5c7-495e-b14a-ac464d76f97f'} Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:55.371006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:55.372595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:55.374221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:55.374221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-fc1ef726-fd36-4c30-b46d-1b0a07c9720b tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 404 len: 111 microversion: 2.20 time: 0.034297 Jun 28 17:54:55.374221 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 413/837] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:55 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:54:55.380195 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d1df0125-ff84-42ca-a075-ed84d73048ed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '.version_select at 0x7f5772115670>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:55.401699 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d1df0125-ff84-42ca-a075-ed84d73048ed tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265824213" status: 204 len: 0 microversion: 2.20 time: 0.026638 Jun 28 17:54:55.402287 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 425/838] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Jun 28 17:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265824213 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 17:54:57.479219 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:57.479737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:57.487220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:57.487666 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:57.488641 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:57.489056 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:57.505971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f HTTP/1.1 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:54:57.507549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.509088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '5f29a2a9-c5c7-495e-b14a-ac464d76f97f'} Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:57.509907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.511352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.513255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:57.513255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1852f82e-fc40-49d3-9e93-b7bb8e18bd1f tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 404 len: 111 microversion: 2.20 time: 0.033921 Jun 28 17:54:57.513255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 414/839] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 28 17:54:57 2022] DELETE /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:54:57.518824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:57.519620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: 5f29a2a9-c5c7-495e-b14a-ac464d76f97f] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:57.527272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:57.527802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:57.528620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:57.529067 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:57.542707 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f HTTP/1.1 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:54:57.544935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.547087 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '5f29a2a9-c5c7-495e-b14a-ac464d76f97f'} Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:57.548369 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. Jun 28 17:54:57.550649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:57.552922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance 5f29a2a9-c5c7-495e-b14a-ac464d76f97f could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:57.552922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0b0c7039-0643-46d9-8691-743adbe4a1c3 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f" status: 404 len: 111 microversion: 2.20 time: 0.032170 Jun 28 17:54:57.552922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 426/840] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:57 2022] GET /compute/v2.1/servers/5f29a2a9-c5c7-495e-b14a-ac464d76f97f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:54:58.717689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:58.718584 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:58.725531 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:58.725981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:58.726809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:58.727226 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:58.741560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b HTTP/1.1 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:54:58.743411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.745250 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b'} Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:58.746172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.747777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.749439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:58.749439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-692a41e3-aea3-4365-af90-d5867de63da0 tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 404 len: 111 microversion: 2.20 time: 0.031356 Jun 28 17:54:58.749439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 415/841] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 28 17:54:58 2022] DELETE /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:54:58.755093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:54:58.755697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] [instance: f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:54:58.762540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:58.762984 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:58.764559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:54:58.765004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:54:58.780178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] HTTP exception thrown: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Request method failure captured: Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b HTTP/1.1 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiuz7nN9vVoGcpxHv74irGctmCjNVhNps29e5MLs4Hnvkcbf3RIb_VaJ38fONWRu4S3WGsHJpAajO3hduqJrmeF-gtVW59CA75U0EpobrAQYouRhsvHgU4nxvxnyH5wXEwqc8Omj2Fd7wubY5GgBdc7nT3c9gxHsuUreaw9UsBMzQZwFM Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:54:58.781765 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/617c65d2596b4cce9db8ef1806b98460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/617c65d2596b4cce9db8ef1806b98460"}]}] Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 617c65d2596b4cce9db8ef1806b98460 Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1494743709 Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 2a63dee5a6194467a325c9499cd89bb0 Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1494743709-project Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.783596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b'} Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:54:58.784516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. Jun 28 17:54:58.785944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:54:58.787272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] Returning 404 to user: Instance f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:54:58.787272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fa008255-b01e-4f98-9e53-8f69c3bbaefb tempest-AttachVolumeShelveTestJSON-1494743709 tempest-AttachVolumeShelveTestJSON-1494743709-project] 10.222.0.43 "GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b" status: 404 len: 111 microversion: 2.20 time: 0.032067 Jun 28 17:54:58.787272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 427/842] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 28 17:54:58 2022] GET /compute/v2.1/servers/f4d2f3c7-e3de-4e82-b1c6-7f1d41af1b0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:55:07.718243 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1229712868", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-226535126", "security_groups": [{"name": "tempest-secgroup-smoke-2079568724"}], "block_device_mapping_v2": [{"uuid": "1ce11e12-dabf-44c0-b95c-96c5042edb93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906f2279-ce2e-4008-b2c1-0164dd91965f"}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:07.856106 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] validate_networks() for [('906f2279-ce2e-4008-b2c1-0164dd91965f', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:55:07.918471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=4 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:08.048399 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-29e8fb88-b4e3-4664-bec1-badf6df71732 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: .version_select at 0x7f5771ea6af0>, body: {"keypair": {"name": "tempest-keypair-203737959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsydvqoOkvgvDaDlpSlDBX1YyVa6Tdhse5xefapTWW4+3Pu+d0oSutVbd0qAvq/EXEIttZC4ZyF2fyZ9+0Lbbt0IaPiGCaOa7RFZbCGl9YLIilokRdxHy4DjA1Xk4psWQ=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:08.063553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-29e8fb88-b4e3-4664-bec1-badf6df71732 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:55:08.067850 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-29e8fb88-b4e3-4664-bec1-badf6df71732 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:55:08.105588 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-29e8fb88-b4e3-4664-bec1-badf6df71732 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188834 Jun 28 17:55:08.106660 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 428/843] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:55:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:08.610081 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:55:08.610513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:55:08.610889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:55:08.611340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:55:08.611820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:55:08.622949 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:08.623406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:08.624215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:08.624730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:08.670383 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:55:08.675445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for user 03f29e8a281f4a2ab15342314d6968d3 and project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:55:08.769498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:55:08.771813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ce11e12-dabf-44c0-b95c-96c5042edb93',volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:55:08.936511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-84102003-08dc-4c6b-9cb7-6559febedcd3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.222854 Jun 28 17:55:08.942366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 416/844] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:55:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:55:08.944119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:08.949355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0ad8557b-126d-47ef-873b-3c766b2272b5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:08.950231 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0ad8557b-126d-47ef-873b-3c766b2272b5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:09.035700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-0ad8557b-126d-47ef-873b-3c766b2272b5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:09.045606 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0ad8557b-126d-47ef-873b-3c766b2272b5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1094 microversion: 2.1 time: 0.102022 Jun 28 17:55:09.046077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 429/845] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:08 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1094 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:09.635021 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1815273023", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ef5600c-56fb-4e68-a629-2bbbc31b7dae"}], "security_groups": [{"name": "tempest-securitygroup--1987722329"}], "key_name": "tempest-keypair-203737959", "user_data": "}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:09.758837 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] validate_networks() for [('3ef5600c-56fb-4e68-a629-2bbbc31b7dae', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:55:10.062061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:10.062732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:10.072420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:10.072892 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:10.073667 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:10.074110 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:10.151958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:10.162931 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5fb43c4a-50d6-4fa9-8207-197ec1e1df74 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1200 microversion: 2.1 time: 0.104769 Jun 28 17:55:10.163815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 430/846] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:10 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:10.247333 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:55:10.247830 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:55:10.247961 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:55:10.248592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:55:10.249411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:55:10.268360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:10.268858 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:10.270787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:10.271660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:10.289620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:55:10.294299 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:55:10.307851 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:55:10.310310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:55:10.365175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9e3e31c2-d7e9-4a87-9953-2cc08fa64b67 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.742831 Jun 28 17:55:10.371295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 417/847] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:55:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:55:10.376687 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d7a5b059-1326-4c75-a9ab-e5106eab4b59 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:10.378019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d7a5b059-1326-4c75-a9ab-e5106eab4b59 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:10.460201 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d7a5b059-1326-4c75-a9ab-e5106eab4b59 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:10.468594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d7a5b059-1326-4c75-a9ab-e5106eab4b59 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1241 microversion: 2.1 time: 0.096222 Jun 28 17:55:10.480772 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 431/848] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:10 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:11.181517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:11.182100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:11.200214 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:11.202834 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:11.204115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:11.206340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:11.493415 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:11.494913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:11.506210 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:11.506943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:11.507903 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:11.508528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:11.616580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:11.630645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:11.632022 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ac3e6c60-d44a-4dcf-bef3-8f48e32b25d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1293 microversion: 2.1 time: 0.146833 Jun 28 17:55:11.632986 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 432/849] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:11 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:11.643094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8a861c7e-9807-479d-abfe-b7e8846e3aff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1278 microversion: 2.1 time: 0.464430 Jun 28 17:55:11.643094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 418/850] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:11 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1278 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:12.185888 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-1dc363c2-5bbd-48bc-9d9d-3d234bc73b6c req-773ef8b5-2df8-4d16-8ebd-33b65a0a7d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4c2e92-aa2c-414a-b9b7-33bf3d22700a", "tag": "29fce24e-609d-4c1a-ad9e-88a3186f39fe"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:12.198216 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-1dc363c2-5bbd-48bc-9d9d-3d234bc73b6c req-773ef8b5-2df8-4d16-8ebd-33b65a0a7d8e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:12.198658 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-1dc363c2-5bbd-48bc-9d9d-3d234bc73b6c req-773ef8b5-2df8-4d16-8ebd-33b65a0a7d8e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:12.235471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-1dc363c2-5bbd-48bc-9d9d-3d234bc73b6c req-773ef8b5-2df8-4d16-8ebd-33b65a0a7d8e service nova] Creating event network-changed:29fce24e-609d-4c1a-ad9e-88a3186f39fe for instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a on hv-cinder-84801 Jun 28 17:55:12.244337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-1dc363c2-5bbd-48bc-9d9d-3d234bc73b6c req-773ef8b5-2df8-4d16-8ebd-33b65a0a7d8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061970 Jun 28 17:55:12.250593 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 419/851] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:12.650780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:12.651569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:12.661007 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:12.661870 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:12.673872 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:12.674724 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:12.675085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:12.675640 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:12.676612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:12.678647 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:12.679120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:12.679828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:12.874109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:12.883471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-249a1680-342b-437c-8413-9038b236b8a7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.229177 Jun 28 17:55:12.899791 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 420/852] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:12 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:12.947835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:12.957288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-498b38b5-2cad-4b56-aac2-1b2044a414cc tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.310607 Jun 28 17:55:12.958121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 433/853] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:12 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:13.729020 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-ec9a3276-be4c-4997-abc3-e0985efe0120 req-bfca04da-972c-4837-92bb-a0cb8c3ffdfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5fa4296-b2b9-4a76-9b97-af72ea6edd3b", "tag": "2fa7a452-7ce9-4b6a-b0de-5f052111cc8a"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:13.742240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ec9a3276-be4c-4997-abc3-e0985efe0120 req-bfca04da-972c-4837-92bb-a0cb8c3ffdfc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:13.742916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ec9a3276-be4c-4997-abc3-e0985efe0120 req-bfca04da-972c-4837-92bb-a0cb8c3ffdfc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:13.769439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-ec9a3276-be4c-4997-abc3-e0985efe0120 req-bfca04da-972c-4837-92bb-a0cb8c3ffdfc service nova] Creating event network-changed:2fa7a452-7ce9-4b6a-b0de-5f052111cc8a for instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b on hv-cinder-84801 Jun 28 17:55:13.779196 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-ec9a3276-be4c-4997-abc3-e0985efe0120 req-bfca04da-972c-4837-92bb-a0cb8c3ffdfc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054672 Jun 28 17:55:13.779717 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 421/854] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:13.901888 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:13.902410 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:13.909297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:13.909769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:13.910580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:13.911015 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:13.975753 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:13.976704 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:13.984182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:13.984605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:13.985384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:13.985815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:14.131213 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:14.139269 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-db17f8de-dbf9-420e-b195-32f63cabd78c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.167720 Jun 28 17:55:14.140855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 422/855] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:13 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:14.160343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:14.168618 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-50e8ac2f-03e5-4790-8644-c897fac32a28 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.270712 Jun 28 17:55:14.169194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 434/856] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:13 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:15.157493 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:15.158270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:15.165483 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:15.165931 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:15.166710 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:15.167147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:15.186017 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:15.187418 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:15.194282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:15.194735 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:15.195512 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:15.195949 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:15.301961 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:15.309804 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8dabe238-3e63-4a6c-b554-0405032d03cd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.156414 Jun 28 17:55:15.310385 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 423/857] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:15 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:15.419116 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:15.430544 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-46136fb1-6167-4e1a-822d-68abbc45d827 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.248316 Jun 28 17:55:15.431125 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 435/858] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:15 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:16.329184 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:16.329737 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:16.336783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:16.337268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:16.338006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:16.338451 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:16.447326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:16.447918 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:16.455507 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:16.455951 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:16.456740 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:16.457196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:16.484001 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:16.492129 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-84534e26-f485-4ebf-b5dc-0e1f3a7eced8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.168503 Jun 28 17:55:16.492721 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 424/859] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:16 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:16.599124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:16.609580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3907309a-c6ec-424e-acfa-1920e4b6d7ee tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.166027 Jun 28 17:55:16.610178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 436/860] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:16 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:17.511534 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:17.512135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:17.522979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:17.523471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:17.524723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:17.525321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:17.631796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:17.632419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:17.639312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:17.639808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:17.641829 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:17.642267 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:17.663960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:17.673278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-39405bd8-8bf1-4cab-877a-f945cc3201f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.166852 Jun 28 17:55:17.674043 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 425/861] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:17 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:17.788825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:17.797951 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-038e5f05-ad1a-48dd-a72a-08065b302dff tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.170343 Jun 28 17:55:17.798517 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 437/862] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:17 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:18.691524 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:18.692182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:18.700160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:18.700739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:18.701558 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:18.702111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:18.814932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:18.815550 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:18.822420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:18.822873 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:18.824138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:18.824138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:18.856926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:18.865517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-89d76186-c618-4e46-b40d-c331cb6361df tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.178351 Jun 28 17:55:18.866109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 426/863] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:18 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:18.965921 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:18.974220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-387d4f83-700c-409c-b8ab-522cbf921439 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.163346 Jun 28 17:55:18.974793 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 438/864] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:18 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:19.289895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-c7f08f6a-4f3b-4fbe-81e4-a499b048801d req-fc23586c-51a1-4863-902a-d0f3f50f14da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fa4296-b2b9-4a76-9b97-af72ea6edd3b", "name": "network-vif-plugged", "status": "completed", "tag": "2fa7a452-7ce9-4b6a-b0de-5f052111cc8a"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:19.300395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-c7f08f6a-4f3b-4fbe-81e4-a499b048801d req-fc23586c-51a1-4863-902a-d0f3f50f14da service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:19.300973 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-c7f08f6a-4f3b-4fbe-81e4-a499b048801d req-fc23586c-51a1-4863-902a-d0f3f50f14da service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:19.315486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-c7f08f6a-4f3b-4fbe-81e4-a499b048801d req-fc23586c-51a1-4863-902a-d0f3f50f14da service nova] Creating event network-vif-plugged:2fa7a452-7ce9-4b6a-b0de-5f052111cc8a for instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b on hv-cinder-84801 Jun 28 17:55:19.320803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-c7f08f6a-4f3b-4fbe-81e4-a499b048801d req-fc23586c-51a1-4863-902a-d0f3f50f14da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035227 Jun 28 17:55:19.321413 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 427/865] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:19.884728 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:19.885281 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:19.893037 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:19.893488 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:19.894250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:19.894678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:19.992130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:19.992849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:19.999456 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:19.999979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:20.001000 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:20.001568 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:20.034129 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:20.042203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4a5e6663-7b47-4eae-84fa-8c1b33436598 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.161443 Jun 28 17:55:20.042892 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 439/866] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:19 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:20.144074 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:20.155996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ef91fa11-9bfc-4798-bafb-147584283d6e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.168217 Jun 28 17:55:20.156942 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 428/867] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:19 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:21.059204 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:21.060604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:21.063283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=8 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:21.064847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:21.071746 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:21.072179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:21.073118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:21.073585 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:21.177820 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:21.179171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:21.181248 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:21.181915 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=12 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:21.193192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:21.194030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:21.194881 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:21.195515 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:21.213881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:21.222164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-451e7894-b62b-4756-8d03-78dca4d8fd06 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1367 microversion: 2.1 time: 0.166799 Jun 28 17:55:21.222754 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 440/868] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:21 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:21.340207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:21.348430 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-88d4d3e5-92b7-4e9f-b028-b4c8ddf0c484 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.174423 Jun 28 17:55:21.349014 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 429/869] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:21 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:22.239393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:22.239981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:22.246977 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.247433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.248212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.248785 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.366412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:22.367173 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:22.369577 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:22.374777 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.375215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.375980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.376492 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.380122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=89 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:22.395104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:22.403002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9f0c4528-b46d-46ab-a745-6b509183915f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1556 microversion: 2.1 time: 0.168068 Jun 28 17:55:22.403580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 441/870] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:22 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:22.421259 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:22.421944 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:22.428966 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.429579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.430532 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:22.431065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:22.512368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d85c108f-d75b-4786-acf7-7796c2288fb4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094967 Jun 28 17:55:22.512997 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 442/871] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:55:22 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:22.523442 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:22.531580 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-238b07a0-f0b0-4d0f-9c03-2009c37675d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.169081 Jun 28 17:55:22.532160 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 430/872] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:22 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:23.313342 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-f1f45e39-4f22-42b3-949d-96b93473e2ee req-8e621f7b-3636-4aea-a058-1f8ef9fb0019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4c2e92-aa2c-414a-b9b7-33bf3d22700a", "name": "network-vif-plugged", "status": "completed", "tag": "29fce24e-609d-4c1a-ad9e-88a3186f39fe"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:23.323466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-f1f45e39-4f22-42b3-949d-96b93473e2ee req-8e621f7b-3636-4aea-a058-1f8ef9fb0019 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:23.324076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-f1f45e39-4f22-42b3-949d-96b93473e2ee req-8e621f7b-3636-4aea-a058-1f8ef9fb0019 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:23.354311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-f1f45e39-4f22-42b3-949d-96b93473e2ee req-8e621f7b-3636-4aea-a058-1f8ef9fb0019 service nova] Creating event network-vif-plugged:29fce24e-609d-4c1a-ad9e-88a3186f39fe for instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a on hv-cinder-84801 Jun 28 17:55:23.362414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-f1f45e39-4f22-42b3-949d-96b93473e2ee req-8e621f7b-3636-4aea-a058-1f8ef9fb0019 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053371 Jun 28 17:55:23.363327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 443/873] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:23.549727 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:23.550351 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:23.558597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:23.559169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:23.560310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:23.561001 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:23.707006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:23.714900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-96454a72-35d7-436c-bb4b-0695afc83c0d tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.169477 Jun 28 17:55:23.715323 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 431/874] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:23 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:23.887478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-e46c270f-f7f5-4d71-980c-18cc4f34305f req-554774bd-eece-4484-bf35-1ad80bb53ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5fa4296-b2b9-4a76-9b97-af72ea6edd3b", "tag": "2fa7a452-7ce9-4b6a-b0de-5f052111cc8a"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:23.896584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-e46c270f-f7f5-4d71-980c-18cc4f34305f req-554774bd-eece-4484-bf35-1ad80bb53ae8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:23.897071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-e46c270f-f7f5-4d71-980c-18cc4f34305f req-554774bd-eece-4484-bf35-1ad80bb53ae8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:23.908833 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-e46c270f-f7f5-4d71-980c-18cc4f34305f req-554774bd-eece-4484-bf35-1ad80bb53ae8 service nova] Creating event network-changed:2fa7a452-7ce9-4b6a-b0de-5f052111cc8a for instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b on hv-cinder-84801 Jun 28 17:55:23.913700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-e46c270f-f7f5-4d71-980c-18cc4f34305f req-554774bd-eece-4484-bf35-1ad80bb53ae8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030383 Jun 28 17:55:23.914549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 444/875] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:24.732341 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:24.732992 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:24.740274 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:24.740855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:24.741751 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:24.742039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:24.892956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:24.901355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d532e06e-4bad-448f-9bbc-3d9bc303d2b7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1266 microversion: 2.1 time: 0.172900 Jun 28 17:55:24.901950 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 432/876] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:24 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:25.920320 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:25.921099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:25.927776 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:25.928292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:25.929128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:25.929566 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:26.090714 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:26.099084 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b10c548d-6cdc-415e-a238-0f025a16eba3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1452 microversion: 2.1 time: 0.183820 Jun 28 17:55:26.099621 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 445/877] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:25 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:55:26.116339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:26.116976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:26.124598 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:26.125045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:26.125813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:26.126244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:26.283319 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:55:26.294149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9692ff00-ed82-4cca-8a96-501fde89f0d8 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1452 microversion: 2.1 time: 0.181927 Jun 28 17:55:26.295040 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 433/878] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:55:26 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:55:28.158730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-b4cdb61c-94d6-4d10-9d77-b1818178357f req-f79ba751-d8e0-44b9-ba3d-5277f6359226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4c2e92-aa2c-414a-b9b7-33bf3d22700a", "tag": "29fce24e-609d-4c1a-ad9e-88a3186f39fe"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:55:28.168535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b4cdb61c-94d6-4d10-9d77-b1818178357f req-f79ba751-d8e0-44b9-ba3d-5277f6359226 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:28.169030 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b4cdb61c-94d6-4d10-9d77-b1818178357f req-f79ba751-d8e0-44b9-ba3d-5277f6359226 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:28.181143 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-b4cdb61c-94d6-4d10-9d77-b1818178357f req-f79ba751-d8e0-44b9-ba3d-5277f6359226 service nova] Creating event network-changed:29fce24e-609d-4c1a-ad9e-88a3186f39fe for instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a on hv-cinder-84801 Jun 28 17:55:28.186565 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-b4cdb61c-94d6-4d10-9d77-b1818178357f req-f79ba751-d8e0-44b9-ba3d-5277f6359226 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032166 Jun 28 17:55:28.187326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 446/879] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:55:59.900287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:55:59.900963 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:55:59.903592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=7 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:59.904437 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=23 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:59.913335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:59.913787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:59.914571 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:55:59.915005 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:55:59.945977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b23a02b7-1af2-42cb-b3b8-34d00f21f4e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/ips" status: 200 len: 148 microversion: 2.1 time: 0.050528 Jun 28 17:55:59.946557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 434/880] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:55:59 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:01.341053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=13 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:01.342024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=82 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:01.348191 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c00525-9b84-42bf-94de-7834b9e68dc6"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:01.349383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:01.356729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:01.357182 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:01.357954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:01.358393 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:01.640474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-01942639-917d-40d8-853e-30e4705806c4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301378 Jun 28 17:56:01.641255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 447/881] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:56:01 2022] POST /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:09.213948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: .version_select at 0x7f5772019af0>, body: {"keypair": {"name": "tempest-keypair-402821649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInh7869RIHunb64lDQnv+AnqKXqO19J1OGlMPZ6kAw/12e+sxnOpgkmPoTgCxXC6/qDTsSvaWw5TEIXc2Gmze2Rz2Sk0/3AGxosXyt2CSn47KPf/TK4pgO8iI4ezI5HkQ=="}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:09.229928 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:56:09.234035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:56:09.246140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [179794f9-539d-4791-b708-543088708a7f] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 28 17:56:09.940509 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:10.255032 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO oslo.messaging._drivers.impl_rabbit [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [179794f9-539d-4791-b708-543088708a7f] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 45792. Jun 28 17:56:10.276154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7eda47ad-6fb0-4e25-9441-6fd6d90035a3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.066071 Jun 28 17:56:10.276794 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 435/882] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:56:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:11.619869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:11.624518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-175762562", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ef5600c-56fb-4e68-a629-2bbbc31b7dae"}], "security_groups": [{"name": "tempest-securitygroup--95716370"}], "key_name": "tempest-keypair-402821649", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:11.631072 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:11.734148 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] validate_networks() for [('3ef5600c-56fb-4e68-a629-2bbbc31b7dae', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:56:12.403044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:56:12.403592 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:56:12.404055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:56:12.404493 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:56:12.404899 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:56:12.414555 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:12.415009 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:12.415807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:12.416241 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:12.433824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:56:12.437737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:56:12.448773 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:56:12.451099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:56:12.503935 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8a394b82-6b61-488d-8e77-db368f0232c6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.885425 Jun 28 17:56:12.504607 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 448/883] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:56:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:56:12.515722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-600b16ed-f95f-4819-83f3-8f83b3a3fa07 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:12.516279 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-600b16ed-f95f-4819-83f3-8f83b3a3fa07 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:12.575926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-600b16ed-f95f-4819-83f3-8f83b3a3fa07 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:12.582518 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-600b16ed-f95f-4819-83f3-8f83b3a3fa07 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1240 microversion: 2.1 time: 0.071527 Jun 28 17:56:12.583342 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 436/884] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:12 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:13.601660 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:13.603229 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:13.610801 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:13.611373 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:13.612282 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:13.612972 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:13.701755 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:13.709898 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-04e5bba5-b17b-47f6-b2f3-b31fa0458ab3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1310 microversion: 2.1 time: 0.114308 Jun 28 17:56:13.710845 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 449/885] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:13 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1310 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:14.728300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:14.728969 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:14.735808 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:14.736262 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:14.737087 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:14.737527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:14.874864 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:14.892434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b6ba8364-822a-4d6a-9800-83a9c8219756 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.159990 Jun 28 17:56:14.892434 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 437/886] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:14 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:15.109598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-658acaa2-7947-44df-b7b8-465d613a8c14 req-3f0e4f92-5ffd-48ef-9550-eea70574ef38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "980b95d7-3d7f-4e39-a5f3-87d473488328", "tag": "c2f7887a-8894-4975-9cfb-e600ccda32ca"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:15.121487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-658acaa2-7947-44df-b7b8-465d613a8c14 req-3f0e4f92-5ffd-48ef-9550-eea70574ef38 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:15.121932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-658acaa2-7947-44df-b7b8-465d613a8c14 req-3f0e4f92-5ffd-48ef-9550-eea70574ef38 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:15.147086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-658acaa2-7947-44df-b7b8-465d613a8c14 req-3f0e4f92-5ffd-48ef-9550-eea70574ef38 service nova] Creating event network-changed:c2f7887a-8894-4975-9cfb-e600ccda32ca for instance 980b95d7-3d7f-4e39-a5f3-87d473488328 on hv-cinder-84801 Jun 28 17:56:15.157839 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-658acaa2-7947-44df-b7b8-465d613a8c14 req-3f0e4f92-5ffd-48ef-9550-eea70574ef38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053541 Jun 28 17:56:15.159270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 450/887] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:15.902194 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:15.902826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:15.910064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:15.910488 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:15.911478 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:15.911909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:16.068149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:16.076503 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-07b930f3-aaa2-4b55-ad9c-a9f32fd50ceb tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.178240 Jun 28 17:56:16.077124 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 438/888] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:15 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:56:17.097435 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:17.098150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:17.105220 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:17.105661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:17.106420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:17.106851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:17.258925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:17.266975 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a050f5cd-a5cd-4bdf-bfc8-86731539fcff tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.174613 Jun 28 17:56:17.267549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 451/889] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:17 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:18.284970 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:18.285669 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:18.292996 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:18.293437 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:18.294205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:18.294622 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:18.443352 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:18.455695 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6ecdd7db-728a-4887-8cfc-aba63a62e886 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.174583 Jun 28 17:56:18.456431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 439/890] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:18 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:19.473694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:19.474433 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:19.482124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:19.482604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:19.483404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:19.484059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:19.571884 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-d227eb6c-fa1f-490e-889c-69dc76cf5d6c req-0b65a46c-3db1-4fec-9bda-931d393afecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980b95d7-3d7f-4e39-a5f3-87d473488328", "name": "network-vif-plugged", "status": "completed", "tag": "c2f7887a-8894-4975-9cfb-e600ccda32ca"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:19.586994 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-d227eb6c-fa1f-490e-889c-69dc76cf5d6c req-0b65a46c-3db1-4fec-9bda-931d393afecc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:19.587443 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-d227eb6c-fa1f-490e-889c-69dc76cf5d6c req-0b65a46c-3db1-4fec-9bda-931d393afecc service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:19.600560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-d227eb6c-fa1f-490e-889c-69dc76cf5d6c req-0b65a46c-3db1-4fec-9bda-931d393afecc service nova] Creating event network-vif-plugged:c2f7887a-8894-4975-9cfb-e600ccda32ca for instance 980b95d7-3d7f-4e39-a5f3-87d473488328 on hv-cinder-84801 Jun 28 17:56:19.610291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-d227eb6c-fa1f-490e-889c-69dc76cf5d6c req-0b65a46c-3db1-4fec-9bda-931d393afecc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044380 Jun 28 17:56:19.611225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 440/891] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:19.635496 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:19.645419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9a855523-b22d-4a8b-93ed-91a20d291aef tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.175441 Jun 28 17:56:19.646703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 452/892] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:19 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:20.665620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:20.666297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:20.673630 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:20.674100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:20.674883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:20.675297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:20.881047 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:20.892920 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1b03bbff-fe08-49ef-b5f9-41552af49331 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1364 microversion: 2.1 time: 0.232385 Jun 28 17:56:20.896563 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 441/893] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:20 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:21.909856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:21.910566 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:21.918035 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:21.918487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:21.919274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:21.919713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:22.125443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:22.137142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-203bf400-5575-4941-a3ef-83c432c0cf6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1554 microversion: 2.1 time: 0.230974 Jun 28 17:56:22.137848 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 453/894] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:21 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:22.157212 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:22.157773 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:22.164714 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:22.165094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:22.165853 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:22.166301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:22.245497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0bc6d6f9-a236-4be8-969b-8f9c8d11969f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092124 Jun 28 17:56:22.246095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 442/895] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:56:22 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:23.262018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-19083816-8414-4049-9ecf-dc15c3cfd667 req-39e121ed-71fd-4c34-ac33-0df8200d609a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "980b95d7-3d7f-4e39-a5f3-87d473488328", "tag": "c2f7887a-8894-4975-9cfb-e600ccda32ca"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:23.266048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:23.266977 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:23.275018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-19083816-8414-4049-9ecf-dc15c3cfd667 req-39e121ed-71fd-4c34-ac33-0df8200d609a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:23.275460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-19083816-8414-4049-9ecf-dc15c3cfd667 req-39e121ed-71fd-4c34-ac33-0df8200d609a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:23.288081 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-19083816-8414-4049-9ecf-dc15c3cfd667 req-39e121ed-71fd-4c34-ac33-0df8200d609a service nova] Creating event network-changed:c2f7887a-8894-4975-9cfb-e600ccda32ca for instance 980b95d7-3d7f-4e39-a5f3-87d473488328 on hv-cinder-84801 Jun 28 17:56:23.293634 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-19083816-8414-4049-9ecf-dc15c3cfd667 req-39e121ed-71fd-4c34-ac33-0df8200d609a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035301 Jun 28 17:56:23.294458 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 454/896] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:29.102390 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:29.107832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:29.108361 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:29.117354 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:29.117803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:29.118574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:29.119006 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:29.304118 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lazy-loading 'flavor' on Instance uuid 32788ad3-0665-4176-82a1-ff9cb3c74952 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:56:29.382225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-46b8f053-1fb4-4866-90cd-659e44a07355 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "POST /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952/action" status: 202 len: 0 microversion: 2.1 time: 0.280452 Jun 28 17:56:29.384483 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 443/897] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:56:29 2022] POST /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:56:29.393927 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:29.394720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:29.402619 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:29.403832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:29.404867 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:29.405396 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:29.556868 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:29.565462 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-10595284-5613-4556-9093-99ab28074477 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.176703 Jun 28 17:56:29.566233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 455/898] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:29 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:30.588570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:30.589218 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:30.591304 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:30.596584 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:30.597034 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:30.597798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:30.598225 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:30.749379 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:30.762424 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-723e3b0a-37d4-4428-b515-0688e3a439ca tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.180328 Jun 28 17:56:30.764542 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 444/899] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:30 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:31.786705 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:31.787326 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:31.795981 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:31.796472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:31.797268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:31.797708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:31.959750 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:31.968622 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-caa87df5-917f-40dc-8665-bb99fe4fa05a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.185722 Jun 28 17:56:31.969219 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 456/900] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:31 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:32.995353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:32.995989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:33.003186 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:33.003559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:33.004322 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:33.004800 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:33.149079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:33.157129 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5dcd6cc7-de5f-429e-ac32-834d41fdbf7e tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.165670 Jun 28 17:56:33.157674 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 445/901] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:32 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:34.174451 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:34.175086 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:34.182359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:34.182814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:34.183589 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:34.184024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:34.331989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:34.340544 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b4460e68-fcf6-493f-b48c-186cf1626f10 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.169865 Jun 28 17:56:34.341137 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 457/902] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:34 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:35.358418 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:35.359011 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:35.365959 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:35.366429 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:35.367215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:35.367621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:35.510690 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:35.518983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-955f4740-d60f-4a01-b18e-d1fe8cada3bd tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.164561 Jun 28 17:56:35.519557 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 446/903] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:35 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:36.536730 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:36.537318 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:36.544119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:36.544638 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:36.545404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:36.545842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:36.707373 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:36.716645 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-05e5e2c6-62ca-49db-bd66-4bb0ae48fc63 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.183849 Jun 28 17:56:36.717471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 458/904] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:36 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:37.733572 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:37.734207 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:37.741676 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:37.742154 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:37.743054 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:37.743498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:37.889607 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:37.897699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2cd7561f-6ed4-4432-b372-af2d4cae13d6 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.167985 Jun 28 17:56:37.898276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 447/905] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:37 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:38.917114 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:38.917773 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:38.924742 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:38.925199 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:38.925990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:38.926460 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:39.068866 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:39.077431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ca946df4-dae1-4a0f-812a-40b1247d236a tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.165550 Jun 28 17:56:39.078012 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 459/906] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:38 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:40.094975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:40.095680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:40.102521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:40.102976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:40.103758 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:40.104199 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:40.107137 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:40.250663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:40.262165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9e60c84a-584b-4bd6-a565-f2df0001f7d9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.170938 Jun 28 17:56:40.262938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 448/907] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:40 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:41.284540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:41.285301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:41.292637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:41.293193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:41.293992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:41.294402 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:41.442635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:41.451382 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-02e58f84-c557-4e05-856f-9e64aa577a74 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.170833 Jun 28 17:56:41.451947 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 460/908] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:41 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:42.469301 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:42.470142 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:42.477064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.477511 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.478277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.478715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.628172 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:42.636902 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-234422de-3f68-4c0b-b103-8dccee0195f1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1571 microversion: 2.1 time: 0.171260 Jun 28 17:56:42.637528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 449/909] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:42 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:42.654350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:42.654939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:42.657529 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:42.663741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.664277 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.665256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.665658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.669464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=67 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:42.758696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-916af4f1-e5e7-4d57-a8c5-6c4c8cba5826 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "POST /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952/action" status: 202 len: 0 microversion: 2.1 time: 0.108179 Jun 28 17:56:42.760605 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 461/910] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 28 17:56:42 2022] POST /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:56:42.770678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:42.771909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:42.780039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.780533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.781332 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:42.781772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:42.941547 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:42.951348 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-141a978e-7518-4252-9114-5ce4bb4068f9 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1579 microversion: 2.1 time: 0.185885 Jun 28 17:56:42.952163 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 450/911] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:42 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:43.978028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:43.978694 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:43.987164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:43.987571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:43.988404 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:43.988881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:44.407331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:44.419090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2d12e657-9a59-403d-85dc-963806a71172 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1521 microversion: 2.1 time: 0.444809 Jun 28 17:56:44.419892 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 462/912] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:43 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:45.437979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:45.438590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:45.445360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:45.445816 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:45.446579 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:45.447015 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:45.595554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:45.604494 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-71185962-299d-4a91-a81d-7c0dfae3953b tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.170391 Jun 28 17:56:45.606262 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 451/913] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:45 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:45.630003 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-be3252c0-5cf7-4a13-8751-77277d25e0b2 req-d3540ae2-9ebd-4116-9536-9092718d5438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "name": "network-vif-unplugged", "status": "completed", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:45.641185 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-be3252c0-5cf7-4a13-8751-77277d25e0b2 req-d3540ae2-9ebd-4116-9536-9092718d5438 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:45.642048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-be3252c0-5cf7-4a13-8751-77277d25e0b2 req-d3540ae2-9ebd-4116-9536-9092718d5438 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:45.657840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-be3252c0-5cf7-4a13-8751-77277d25e0b2 req-d3540ae2-9ebd-4116-9536-9092718d5438 service nova] Creating event network-vif-unplugged:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:56:45.663876 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-be3252c0-5cf7-4a13-8751-77277d25e0b2 req-d3540ae2-9ebd-4116-9536-9092718d5438 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038774 Jun 28 17:56:45.664659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 463/914] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:46.630411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:46.631313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:46.640165 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:46.640681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:46.641461 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:46.641901 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:46.778210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:46.789601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5cd1f11c-7ab4-4d18-b662-fcbce314c112 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.165418 Jun 28 17:56:46.790249 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 452/915] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:46 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:47.815296 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:47.816335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:47.825328 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:47.825777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:47.826560 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:47.826992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:47.984536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:47.992734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d7d4cd2e-fd53-471d-a116-53ea5d14168f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.184311 Jun 28 17:56:47.993329 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 464/916] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:47 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:49.012976 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:49.013606 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:49.023926 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:49.024601 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:49.025547 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:49.026121 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:49.170813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:49.182092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-26eca203-101b-41d3-aef3-01d4c4a3b223 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.174598 Jun 28 17:56:49.182846 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 453/917] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:49 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:50.200774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:50.201392 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:50.208580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:50.209052 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:50.209812 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:50.210238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:50.360817 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:50.372687 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ea05191c-f26b-4c73-b2dd-d56d83ee4606 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.176357 Jun 28 17:56:50.373292 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 465/918] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:50 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:51.396455 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:51.397310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:51.406164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:51.406740 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:51.407765 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:51.408321 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:51.552277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:51.560028 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-11147ed2-e764-4c42-8e2e-e395e225a9b1 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.167851 Jun 28 17:56:51.561451 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 454/919] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:51 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:52.580045 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:52.584642 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:52.592684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:52.593566 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:52.594420 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:52.595082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:52.756562 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:52.766540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-71610073-ee17-43e3-9258-5de45f2df94f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1577 microversion: 2.1 time: 0.192018 Jun 28 17:56:52.767690 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 466/920] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:52 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:53.786845 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:53.787560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:53.794284 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:53.794766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:53.795541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:53.796244 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:53.933441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:53.941661 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b1aa5d40-49c9-439c-ad69-d2cb26e7bc59 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1564 microversion: 2.1 time: 0.158736 Jun 28 17:56:53.942269 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 455/921] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:53 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:55.765510 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-5fc0d288-eeff-4f9f-9bab-65a22ce23d4e req-716a8ed7-8a0a-499e-a605-bdfe7699da69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "name": "network-vif-plugged", "status": "completed", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:55.776120 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-5fc0d288-eeff-4f9f-9bab-65a22ce23d4e req-716a8ed7-8a0a-499e-a605-bdfe7699da69 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:55.776626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-5fc0d288-eeff-4f9f-9bab-65a22ce23d4e req-716a8ed7-8a0a-499e-a605-bdfe7699da69 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:55.789817 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-5fc0d288-eeff-4f9f-9bab-65a22ce23d4e req-716a8ed7-8a0a-499e-a605-bdfe7699da69 service nova] Creating event network-vif-plugged:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:56:55.794989 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-5fc0d288-eeff-4f9f-9bab-65a22ce23d4e req-716a8ed7-8a0a-499e-a605-bdfe7699da69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Jun 28 17:56:55.795806 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 467/922] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:56:58.260809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:58.261430 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:58.269439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.269909 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.270686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.271133 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.295447 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9e6795f1-aeaa-49ec-8619-2f776683b299 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/ips" status: 200 len: 150 microversion: 2.1 time: 0.038640 Jun 28 17:56:58.296023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 456/923] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:56:58 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:56:58.308256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c00525-9b84-42bf-94de-7834b9e68dc6"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:56:58.309436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:58.316950 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.317301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.318085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.318509 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.409192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/os-volume_attachments HTTP/1.1 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 74 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:56:58.410971 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volumeAttachment": {"volumeId": "06c00525-9b84-42bf-94de-7834b9e68dc6"}} Jun 28 17:56:58.412682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'server_id': '980b95d7-3d7f-4e39-a5f3-87d473488328', 'body': {'volumeAttachment': {'volumeId': '06c00525-9b84-42bf-94de-7834b9e68dc6'}}} Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:56:58.414065 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:56:58.417109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 400 to user: Invalid volume: volume 06c00525-9b84-42bf-94de-7834b9e68dc6 is already attached to instances: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-12298189-1dc8-4c61-bda1-0fc1a40417f9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108704 Jun 28 17:56:58.419818 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 468/924] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:56:58 2022] POST /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:56:58.422337 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:58.422911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:58.429210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.429656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.430415 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.430849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.455498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:56:58.532818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a3d0a149-344e-4857-b04e-24ca42568ac2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 204 len: 0 microversion: 2.1 time: 0.113843 Jun 28 17:56:58.533401 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 457/925] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:56:58 2022] DELETE /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 17:56:58.543109 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:58.543733 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:58.551984 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.552516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.553283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:58.553727 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:58.700868 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:58.713261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d3bdf9e4-2dd3-4291-b120-27ac90d5d3b7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1679 microversion: 2.1 time: 0.175149 Jun 28 17:56:58.713848 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 469/926] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:58 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:56:59.737725 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:56:59.738435 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:56:59.745455 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:59.745907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:59.746677 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:56:59.747115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:56:59.893603 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:56:59.901767 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4ddb6693-f163-41d5-84a7-353e53f63a30 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1679 microversion: 2.1 time: 0.169955 Jun 28 17:56:59.902300 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 458/927] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:56:59 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:00.919445 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:00.920050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:00.927101 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:00.927574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:00.928351 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:00.928847 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:01.028359 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:01.049338 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a8e74287-b14c-4d7f-8341-0ca9d8bd794a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 200 len: 1613 microversion: 2.1 time: 0.133716 Jun 28 17:57:01.050060 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 470/928] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:00 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 1613 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:01.092205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-787c0048-1f46-4427-ac5d-3a11ca80f5b4 req-86c40167-29d2-4ddb-8efa-78022f37d90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980b95d7-3d7f-4e39-a5f3-87d473488328", "name": "network-vif-deleted", "tag": "c2f7887a-8894-4975-9cfb-e600ccda32ca"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:01.098270 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:01.102520 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-787c0048-1f46-4427-ac5d-3a11ca80f5b4 req-86c40167-29d2-4ddb-8efa-78022f37d90e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:01.103786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-787c0048-1f46-4427-ac5d-3a11ca80f5b4 req-86c40167-29d2-4ddb-8efa-78022f37d90e service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:01.117326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-787c0048-1f46-4427-ac5d-3a11ca80f5b4 req-86c40167-29d2-4ddb-8efa-78022f37d90e service nova] Creating event network-vif-deleted:c2f7887a-8894-4975-9cfb-e600ccda32ca for instance 980b95d7-3d7f-4e39-a5f3-87d473488328 on hv-cinder-84801 Jun 28 17:57:01.134945 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-787c0048-1f46-4427-ac5d-3a11ca80f5b4 req-86c40167-29d2-4ddb-8efa-78022f37d90e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046170 Jun 28 17:57:01.136407 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 459/929] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:02.066852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:02.067825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:02.075250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:02.075697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:02.076505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:02.076962 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:02.092153 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 HTTP/1.1 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:57:02.093852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:57:02.095258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '980b95d7-3d7f-4e39-a5f3-87d473488328'} Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:57:02.096237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:57:02.097766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:02.099374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:57:02.099374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-45130d28-48ef-48e7-a0a8-14aeaa81c106 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 404 len: 111 microversion: 2.1 time: 0.032527 Jun 28 17:57:02.099374 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 471/930] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:02 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:57:02.106416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3d198f7b-2dd9-4f35-a22b-68ec2fa36c7a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '.version_select at 0x7f577206b1f0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:02.127209 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3d198f7b-2dd9-4f35-a22b-68ec2fa36c7a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402821649" status: 202 len: 0 microversion: 2.1 time: 0.026089 Jun 28 17:57:02.127796 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 460/931] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 28 17:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402821649 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:57:02.856932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:02.857414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:02.863840 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:02.864289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:02.865100 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:02.865558 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:02.955396 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lazy-loading 'services' on Instance uuid e5fa4296-b2b9-4a76-9b97-af72ea6edd3b {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:57:03.031466 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bea86e63-f5e1-45f5-8e59-4805aadc2f6d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments/06c00525-9b84-42bf-94de-7834b9e68dc6" status: 202 len: 0 microversion: 2.1 time: 0.178362 Jun 28 17:57:03.032177 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 472/932] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:57:02 2022] DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments/06c00525-9b84-42bf-94de-7834b9e68dc6 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:57:03.041066 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:03.042115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:03.050071 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:03.050517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:03.051325 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:03.051813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:03.083441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8b66d0a8-233f-498e-82fd-67afd869a645 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Jun 28 17:57:03.084033 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 461/933] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:57:03 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:04.099304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:04.100396 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:04.107316 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.107798 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.108588 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.109021 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.138584 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f8d186f5-cebf-4aac-a940-fffceb6d1c18 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045254 Jun 28 17:57:04.139478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 473/934] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:57:04 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:57:04.204901 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:04.205897 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:04.212354 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.212919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.213621 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.214103 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.239741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:57:04.325529 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cc0e385c-3440-4488-a7f7-07e1c5f347c2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 204 len: 0 microversion: 2.1 time: 0.124254 Jun 28 17:57:04.326182 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 462/935] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:57:04 2022] DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:57:04.334545 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:04.335202 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:04.341320 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.341778 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.342536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:04.342978 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:04.480860 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:04.490625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b1f8c74d-f2ad-43e9-9ca4-3c69592d09f3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1680 microversion: 2.1 time: 0.159869 Jun 28 17:57:04.491121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 474/936] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:04 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:05.511505 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:05.512570 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:05.523097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:05.523622 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:05.524426 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:05.525094 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:05.544582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:05.674916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:05.682828 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bd01eb72-4046-44b8-a1f5-7fd017bccdd8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1680 microversion: 2.1 time: 0.178028 Jun 28 17:57:05.683400 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 463/937] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:05 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:06.706782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:06.707439 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:06.714696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:06.715150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:06.715928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:06.716363 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:06.807352 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:06.816118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-122e2e95-7e88-49ef-a96c-2db767f40292 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 200 len: 1612 microversion: 2.1 time: 0.113421 Jun 28 17:57:06.816813 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 475/938] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:06 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:07.178247 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-2227cffd-b199-4d77-a037-474c434dd4a3 req-28e835fa-b963-4665-9c18-fb5a4bf63db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fa4296-b2b9-4a76-9b97-af72ea6edd3b", "name": "network-vif-deleted", "tag": "2fa7a452-7ce9-4b6a-b0de-5f052111cc8a"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:07.187208 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-2227cffd-b199-4d77-a037-474c434dd4a3 req-28e835fa-b963-4665-9c18-fb5a4bf63db8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:07.187789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-2227cffd-b199-4d77-a037-474c434dd4a3 req-28e835fa-b963-4665-9c18-fb5a4bf63db8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:07.200544 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-2227cffd-b199-4d77-a037-474c434dd4a3 req-28e835fa-b963-4665-9c18-fb5a4bf63db8 service nova] Creating event network-vif-deleted:2fa7a452-7ce9-4b6a-b0de-5f052111cc8a for instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b on hv-cinder-84801 Jun 28 17:57:07.205754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-2227cffd-b199-4d77-a037-474c434dd4a3 req-28e835fa-b963-4665-9c18-fb5a4bf63db8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101213 Jun 28 17:57:07.206888 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 464/939] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:07.834152 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:07.834786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:07.842248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:07.842687 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:07.843658 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:07.844088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:07.861136 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b HTTP/1.1 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:57:07.863556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:57:07.865071 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'e5fa4296-b2b9-4a76-9b97-af72ea6edd3b'} Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:57:07.865832 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:57:07.867112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:57:07.868257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:57:07.868257 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b0aa025e-f28b-4b7f-9476-e22e15a5218f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 404 len: 111 microversion: 2.1 time: 0.035461 Jun 28 17:57:07.868784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 476/940] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:07 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:57:07.875052 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-018650fc-8a3d-4c47-860b-2ae357cc90e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '.version_select at 0x7f5771fee820>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:07.895291 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-018650fc-8a3d-4c47-860b-2ae357cc90e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203737959" status: 202 len: 0 microversion: 2.1 time: 0.024584 Jun 28 17:57:07.896065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 465/941] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 28 17:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203737959 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:57:08.903145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e1d13735-0068-47b5-81e4-d2dd7fd81c81 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: .version_select at 0x7f577208dd30>, body: {"keypair": {"name": "tempest-keypair-1588619277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVdkh7eEw6xAokIlXjNuOg9Fp4xk1gbp/bpe/frCc3A39J2cVROndltDG4mP/qAsAwIQxyss1Jy4mF1z5XyNq+N44LLaNuxi2RDqm6UN1DyrQbXDYUVQQwu/kWYas/yLQ=="}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:08.919497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-e1d13735-0068-47b5-81e4-d2dd7fd81c81 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:57:08.924961 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-e1d13735-0068-47b5-81e4-d2dd7fd81c81 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:57:08.955423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e1d13735-0068-47b5-81e4-d2dd7fd81c81 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056209 Jun 28 17:57:08.956028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 477/942] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:57:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:10.296156 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1101458844", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ef5600c-56fb-4e68-a629-2bbbc31b7dae"}], "security_groups": [{"name": "tempest-securitygroup--749142484"}], "key_name": "tempest-keypair-1588619277", "user_data": "}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:10.405779 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] validate_networks() for [('3ef5600c-56fb-4e68-a629-2bbbc31b7dae', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:57:10.850893 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:57:10.851367 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:57:10.851953 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:57:10.852513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:57:10.853051 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:57:10.867153 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:10.867769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:10.869079 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:10.869684 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:10.888471 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:57:10.893474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:57:10.904868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:57:10.907257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:57:10.959143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-db3cabc8-b324-4012-a290-38dde28eaa1f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667909 Jun 28 17:57:10.959798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 466/943] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:57:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:57:10.970709 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a99715c8-42e9-4e0a-9bc1-c383d2987658 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:10.971407 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a99715c8-42e9-4e0a-9bc1-c383d2987658 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:11.036553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a99715c8-42e9-4e0a-9bc1-c383d2987658 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:11.043467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a99715c8-42e9-4e0a-9bc1-c383d2987658 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1242 microversion: 2.1 time: 0.077271 Jun 28 17:57:11.044032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 478/944] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:10 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:12.062134 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:12.062748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:12.071560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:12.072013 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:12.072911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:12.073350 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:12.142706 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:12.151516 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-6128dbb2-7862-4813-ac81-9f8a52ab2d61 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1302 microversion: 2.1 time: 0.094132 Jun 28 17:57:12.152633 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 467/945] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:12 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:13.170237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:13.170859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:13.174430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:13.179034 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:13.179486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:13.180270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:13.180737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:13.184401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:13.380018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:13.388032 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5f7de49a-d054-4f0d-8005-15afc0713556 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.222143 Jun 28 17:57:13.388990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 479/946] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:13 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:13.662750 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-db165f46-8545-47ac-96f8-47f34a312b05 req-658c8710-63b8-4412-a27b-6c36f2ec1361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f815c1-f020-40b6-b538-ab3bde233a05", "tag": "128ee9eb-235f-43f7-8cd9-b93c0f96fcbd"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:13.677355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-db165f46-8545-47ac-96f8-47f34a312b05 req-658c8710-63b8-4412-a27b-6c36f2ec1361 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:13.677966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-db165f46-8545-47ac-96f8-47f34a312b05 req-658c8710-63b8-4412-a27b-6c36f2ec1361 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:13.708686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-db165f46-8545-47ac-96f8-47f34a312b05 req-658c8710-63b8-4412-a27b-6c36f2ec1361 service nova] Creating event network-changed:128ee9eb-235f-43f7-8cd9-b93c0f96fcbd for instance e1f815c1-f020-40b6-b538-ab3bde233a05 on hv-cinder-84801 Jun 28 17:57:13.721908 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-db165f46-8545-47ac-96f8-47f34a312b05 req-658c8710-63b8-4412-a27b-6c36f2ec1361 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065157 Jun 28 17:57:13.722886 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 468/947] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:14.409195 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:14.410354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:14.417020 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:14.417478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:14.418255 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:14.418703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:14.555641 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:14.563805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-10ab96fd-1dc0-429a-9dd3-7f668537a47b tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.160934 Jun 28 17:57:14.564343 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 480/948] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:14 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:15.584595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:15.585233 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:15.594387 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:15.595064 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:15.596162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:15.596894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:15.744704 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:15.752678 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-70f44d2e-db84-4d10-973d-c7b0ed70ba6a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.174649 Jun 28 17:57:15.753259 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 469/949] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:15 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:16.772933 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:16.773836 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:16.784082 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:16.784934 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:16.785689 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:16.786132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:16.933925 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:16.946943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b4e571ce-c529-4a11-97c6-54b86e29cf56 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.179814 Jun 28 17:57:16.947954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 481/950] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:16 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:17.911559 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-ec2b165d-443c-479d-982b-0f6591f4b34b req-014a0681-9b72-4ded-a580-8a97f7ec39ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f815c1-f020-40b6-b538-ab3bde233a05", "name": "network-vif-plugged", "status": "completed", "tag": "128ee9eb-235f-43f7-8cd9-b93c0f96fcbd"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:17.921061 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ec2b165d-443c-479d-982b-0f6591f4b34b req-014a0681-9b72-4ded-a580-8a97f7ec39ac service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:17.922149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-ec2b165d-443c-479d-982b-0f6591f4b34b req-014a0681-9b72-4ded-a580-8a97f7ec39ac service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:17.934349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-ec2b165d-443c-479d-982b-0f6591f4b34b req-014a0681-9b72-4ded-a580-8a97f7ec39ac service nova] Creating event network-vif-plugged:128ee9eb-235f-43f7-8cd9-b93c0f96fcbd for instance e1f815c1-f020-40b6-b538-ab3bde233a05 on hv-cinder-84801 Jun 28 17:57:17.939377 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-ec2b165d-443c-479d-982b-0f6591f4b34b req-014a0681-9b72-4ded-a580-8a97f7ec39ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032585 Jun 28 17:57:17.939974 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 470/951] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:17.964769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:17.965534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:17.972932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:17.973476 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:17.974267 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:17.975387 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:18.147058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:18.157331 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3aef825d-77ea-43c1-80e6-7b3916e40dc0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.196351 Jun 28 17:57:18.158307 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 482/952] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:17 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:19.179112 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:19.179780 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:19.186615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:19.187055 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:19.187813 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:19.188238 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:19.336220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:19.345317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-31cba6e9-a95a-4fe8-9e4f-a85036b848d4 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1367 microversion: 2.1 time: 0.170846 Jun 28 17:57:19.345910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 471/953] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:19 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:20.362908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:20.363481 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:20.370739 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:20.371195 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:20.371977 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:20.372426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:20.515579 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:20.526213 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4f3ee0e6-34ba-4dc0-92ee-dfbf75ceba24 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1556 microversion: 2.1 time: 0.167458 Jun 28 17:57:20.526786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 483/954] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:20 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:20.548189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:20.549124 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:20.555748 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:20.556192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:20.556993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:20.557416 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:20.651132 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-54b6cd1a-1cf1-486c-ad62-561abafcceb6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106626 Jun 28 17:57:20.652036 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 472/955] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:57:20 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:21.940297 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:22.000951 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-d9e6d21c-0c04-4dba-9add-0b9718ab498e req-bdd6a07d-ca64-4b88-b872-bfbffae99f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f815c1-f020-40b6-b538-ab3bde233a05", "tag": "128ee9eb-235f-43f7-8cd9-b93c0f96fcbd"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:22.009864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d9e6d21c-0c04-4dba-9add-0b9718ab498e req-bdd6a07d-ca64-4b88-b872-bfbffae99f65 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:22.010305 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-d9e6d21c-0c04-4dba-9add-0b9718ab498e req-bdd6a07d-ca64-4b88-b872-bfbffae99f65 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:22.022260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-d9e6d21c-0c04-4dba-9add-0b9718ab498e req-bdd6a07d-ca64-4b88-b872-bfbffae99f65 service nova] Creating event network-changed:128ee9eb-235f-43f7-8cd9-b93c0f96fcbd for instance e1f815c1-f020-40b6-b538-ab3bde233a05 on hv-cinder-84801 Jun 28 17:57:22.027693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-d9e6d21c-0c04-4dba-9add-0b9718ab498e req-bdd6a07d-ca64-4b88-b872-bfbffae99f65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091769 Jun 28 17:57:22.028558 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 484/956] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:25.481276 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:25.482042 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:25.487106 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:25.487594 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:25.495445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:25.496057 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:25.496980 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:25.497407 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:25.523560 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:57:25.608865 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-412cf5fc-a45d-4b75-b1fd-a88ae5f99975 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 204 len: 0 microversion: 2.1 time: 0.127941 Jun 28 17:57:25.609555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 473/957] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:57:25 2022] DELETE /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:57:25.618815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:25.619629 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:25.626888 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:25.627344 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:25.628128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:25.628602 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:25.772751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:25.780914 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-b90d6476-67cf-4619-a84c-7a3eafc775d4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1576 microversion: 2.1 time: 0.166374 Jun 28 17:57:25.781522 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 485/958] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:25 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:26.800406 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:26.801147 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:26.808658 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:26.809109 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:26.809905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:26.810339 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:26.964369 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:26.972593 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-25464d53-b08f-4975-a827-60d8cb4a94dd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1576 microversion: 2.1 time: 0.176810 Jun 28 17:57:26.973199 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 474/959] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:26 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:27.989856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:27.991467 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:27.998631 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:27.999093 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:28.000027 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:28.000504 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:28.103449 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:28.112354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ea344870-0b0f-448b-85de-8786ec4c9549 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1508 microversion: 2.1 time: 0.126531 Jun 28 17:57:28.113170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 486/960] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:27 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1508 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:28.400811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-6294ef78-6f4f-4f88-ac16-a7f64bdfa681 req-e51c6612-55ed-490b-b9df-071c7d1b2d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4c2e92-aa2c-414a-b9b7-33bf3d22700a", "name": "network-vif-deleted", "tag": "29fce24e-609d-4c1a-ad9e-88a3186f39fe"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:28.411331 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-6294ef78-6f4f-4f88-ac16-a7f64bdfa681 req-e51c6612-55ed-490b-b9df-071c7d1b2d47 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:28.411793 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-6294ef78-6f4f-4f88-ac16-a7f64bdfa681 req-e51c6612-55ed-490b-b9df-071c7d1b2d47 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:28.428755 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-6294ef78-6f4f-4f88-ac16-a7f64bdfa681 req-e51c6612-55ed-490b-b9df-071c7d1b2d47 service nova] Creating event network-vif-deleted:29fce24e-609d-4c1a-ad9e-88a3186f39fe for instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a on hv-cinder-84801 Jun 28 17:57:28.438979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-6294ef78-6f4f-4f88-ac16-a7f64bdfa681 req-e51c6612-55ed-490b-b9df-071c7d1b2d47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043048 Jun 28 17:57:28.443324 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 475/961] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:29.133118 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:29.133679 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:29.141696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:29.142112 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:29.143126 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:29.144568 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:29.192712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:29.193165 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:29.193616 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lazy-loading 'fault' on Instance uuid 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:57:29.241225 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:29.251552 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5504d057-b594-4f7a-b815-5f6ab745cb9e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 200 len: 1230 microversion: 2.1 time: 0.124056 Jun 28 17:57:29.252224 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 487/962] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:29 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 1230 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:30.270787 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:30.271535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:30.278545 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:30.279000 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:30.279783 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:30.280533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:30.294766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] HTTP exception thrown: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Request method failure captured: Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a HTTP/1.1 Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0BkE4vU5IhVTdA_NIomLcSqf1N8Xhy4yHbZRKcDjEz0ho9c0bTvcCfBZp3LgRz8GXtAKznN-CQT0A6887LCtfn37wez2bOex-Leugm-90yF6z01PI1ilWIO_S1i69e8E9i6dVaQ1PHIKqT9zZvTohPH8zG3Z_t29MojDsvfvbQLcCc Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:57:30.296476 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}] Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-TestVolumeBootPattern-1975677613 Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-TestVolumeBootPattern-1975677613-project Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 03f29e8a281f4a2ab15342314d6968d3 Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-TestVolumeBootPattern-1975677613-project Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 17:57:30.298371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '8f4c2e92-aa2c-414a-b9b7-33bf3d22700a'} Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:57:30.299649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 17:57:30.301890 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:57:30.304065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Returning 404 to user: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:57:30.304065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0cbd6c32-2271-40fb-921b-8b79cd2dedf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 404 len: 111 microversion: 2.1 time: 0.032117 Jun 28 17:57:30.304065 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 476/963] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:30 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:57:30.360122 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1574856322", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-226535126", "security_groups": [{"name": "tempest-secgroup-smoke-2079568724"}], "block_device_mapping_v2": [{"uuid": "1ce11e12-dabf-44c0-b95c-96c5042edb93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906f2279-ce2e-4008-b2c1-0164dd91965f"}]}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:30.497856 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] validate_networks() for [('906f2279-ce2e-4008-b2c1-0164dd91965f', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:57:31.260676 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:57:31.261046 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:57:31.261527 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:57:31.262107 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:57:31.262678 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:57:31.275611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:31.276058 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:31.276949 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:31.277376 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:31.294855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:57:31.299763 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for user 03f29e8a281f4a2ab15342314d6968d3 and project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:57:31.363500 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:57:31.365665 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ce11e12-dabf-44c0-b95c-96c5042edb93',volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:57:31.507820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-cf0c47e1-7024-4c08-9efd-e23c796bbe08 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.153020 Jun 28 17:57:31.509611 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 488/964] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:57:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:57:31.519826 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-54e5559a-d0c9-41a6-a436-d6c5a3dcfc63 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:31.520519 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-54e5559a-d0c9-41a6-a436-d6c5a3dcfc63 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:31.524171 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:31.582862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-54e5559a-d0c9-41a6-a436-d6c5a3dcfc63 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:31.590495 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-54e5559a-d0c9-41a6-a436-d6c5a3dcfc63 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1094 microversion: 2.1 time: 0.074588 Jun 28 17:57:31.591253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 477/965] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:31 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:32.608204 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:32.608964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:32.617352 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:32.618878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:32.619869 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:32.620301 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:32.706307 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:32.717047 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1a3e7d38-a6f1-460d-9eb9-649aa5232edd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1210 microversion: 2.1 time: 0.113288 Jun 28 17:57:32.717643 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 489/966] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:32 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:33.734966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:33.735619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:33.743891 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:33.744371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:33.745384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:33.745818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:33.886470 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:33.894842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7d717627-00c2-4102-8a4e-941e519fe5d2 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.163916 Jun 28 17:57:33.895567 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 478/967] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:33 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:34.188004 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-b961643d-26a5-490c-8715-f02f24c7ea45 req-62ef6c24-db42-4d1a-8eda-76f76d5f6633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2", "tag": "18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:34.198128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b961643d-26a5-490c-8715-f02f24c7ea45 req-62ef6c24-db42-4d1a-8eda-76f76d5f6633 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:34.198487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b961643d-26a5-490c-8715-f02f24c7ea45 req-62ef6c24-db42-4d1a-8eda-76f76d5f6633 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:34.211196 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-b961643d-26a5-490c-8715-f02f24c7ea45 req-62ef6c24-db42-4d1a-8eda-76f76d5f6633 service nova] Creating event network-changed:18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2 for instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 on hv-cinder-84801 Jun 28 17:57:34.216980 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-b961643d-26a5-490c-8715-f02f24c7ea45 req-62ef6c24-db42-4d1a-8eda-76f76d5f6633 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034253 Jun 28 17:57:34.217621 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 490/968] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:34.913855 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:34.914514 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:34.921718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:34.922164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:34.922946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:34.923376 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:35.065541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:35.073946 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-34ae2aa2-1d20-46b3-b75f-1de69619d2e7 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.164064 Jun 28 17:57:35.074533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 479/969] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:34 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:36.093422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:36.094178 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:36.101252 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:36.101703 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:36.102538 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:36.103054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:36.257956 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:36.269626 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-ca127cb4-88ee-4742-808c-5ecc939e519b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.180960 Jun 28 17:57:36.270310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 491/970] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:36 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:37.287793 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:37.288472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:37.295818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:37.296271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:37.297093 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:37.297532 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:37.300362 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:37.451010 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:37.458977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b9efc69d-a627-46f8-b90b-11dac6825dcf tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.175365 Jun 28 17:57:37.459528 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 480/971] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:37 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:38.476348 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:38.477007 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:38.484913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:38.485362 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:38.486134 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:38.486565 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:38.628820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:38.637446 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5ae75d30-7c88-43f5-92a7-bc13fd50bd56 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.165063 Jun 28 17:57:38.638023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 492/972] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:38 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:39.655317 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:39.655957 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:39.663189 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:39.663645 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:39.664448 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:39.664938 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:39.814234 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:39.823035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-9a304718-0ef1-42a5-a254-11167cbcb597 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.171627 Jun 28 17:57:39.823634 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 481/973] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:39 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:40.843228 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:40.844192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:40.854117 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:40.854656 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:40.855614 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:40.856475 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:41.005943 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:41.014119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-3c45926e-3752-4c23-aa78-530b077801ed tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.176677 Jun 28 17:57:41.014701 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 493/974] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:40 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:42.034157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:42.035035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:42.038257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:42.045384 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:42.045865 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:42.046650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:42.047162 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:42.192747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:42.201253 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-100b92f1-5a00-42cb-8775-732a0bd6a387 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.172440 Jun 28 17:57:42.201843 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 482/975] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:42 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:43.219968 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:43.220623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:43.222662 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:43.223335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:43.224740 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:43.231842 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:43.232289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:43.233099 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:43.233534 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:43.237248 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=80 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:43.390068 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:43.398384 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9fa4f726-1d28-4e5f-8c25-0c4c4e3ee5c4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.183314 Jun 28 17:57:43.398932 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 494/976] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:43 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:44.114659 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-2ab5bea3-20d4-47e5-9f3a-07c026507be5 req-61e40e43-299f-4048-b064-2846d693887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2", "name": "network-vif-plugged", "status": "completed", "tag": "18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:44.123296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-2ab5bea3-20d4-47e5-9f3a-07c026507be5 req-61e40e43-299f-4048-b064-2846d693887a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:44.123742 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-2ab5bea3-20d4-47e5-9f3a-07c026507be5 req-61e40e43-299f-4048-b064-2846d693887a service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:44.135466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-2ab5bea3-20d4-47e5-9f3a-07c026507be5 req-61e40e43-299f-4048-b064-2846d693887a service nova] Creating event network-vif-plugged:18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2 for instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 on hv-cinder-84801 Jun 28 17:57:44.141022 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-2ab5bea3-20d4-47e5-9f3a-07c026507be5 req-61e40e43-299f-4048-b064-2846d693887a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090205 Jun 28 17:57:44.141517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 483/977] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:44.415751 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:44.416482 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:44.423549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:44.424002 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:44.424820 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:44.425260 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:44.576780 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:44.587909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-12859d1d-9c3e-4285-8fd4-98fbbc451c26 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1266 microversion: 2.1 time: 0.176051 Jun 28 17:57:44.588637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 495/978] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:44 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:45.606886 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:45.607565 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:45.615697 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:45.616240 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:45.617360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:45.617789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:45.764297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:45.772549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-cde9dd31-d639-4115-af09-8bca6c1c773b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1453 microversion: 2.1 time: 0.171000 Jun 28 17:57:45.773128 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 484/979] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:45 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:45.793560 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:45.794173 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:45.801085 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:45.801536 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:45.802306 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:45.802777 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:45.942024 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:57:45.950351 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5441ce9a-4e55-4776-86d4-982356df255e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1453 microversion: 2.1 time: 0.160754 Jun 28 17:57:45.950960 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 496/980] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:57:45 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:57:47.653007 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-5d6a8f18-34cf-40bd-b0a2-b81c65bc1833 req-2c398873-c0b1-49a3-a92c-de013818900d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2", "tag": "18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:47.661905 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5d6a8f18-34cf-40bd-b0a2-b81c65bc1833 req-2c398873-c0b1-49a3-a92c-de013818900d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:47.662345 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-5d6a8f18-34cf-40bd-b0a2-b81c65bc1833 req-2c398873-c0b1-49a3-a92c-de013818900d service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:47.673472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-5d6a8f18-34cf-40bd-b0a2-b81c65bc1833 req-2c398873-c0b1-49a3-a92c-de013818900d service nova] Creating event network-changed:18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2 for instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 on hv-cinder-84801 Jun 28 17:57:47.678998 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-5d6a8f18-34cf-40bd-b0a2-b81c65bc1833 req-2c398873-c0b1-49a3-a92c-de013818900d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030019 Jun 28 17:57:47.679620 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 485/981] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:58.230280 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:57:58.230913 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:58.233499 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=5 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:58.234169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=17 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:58.239784 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:58.240272 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:58.241180 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:58.241613 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:58.268422 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4f5e8ad0-0314-4b04-b7fa-ca3c6eb8636a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/ips" status: 200 len: 149 microversion: 2.1 time: 0.042076 Jun 28 17:57:58.269203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 497/982] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:57:58 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:57:59.613183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=19 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:59.614375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=27 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:59.621868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b43baebc-6bb5-41b8-b715-cba72cf25305"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:57:59.623625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:57:59.631018 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:59.631467 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:59.632227 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:57:59.632689 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:57:59.915143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-442a1cc9-d83e-470c-a63d-e27b1842d4e0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304481 Jun 28 17:57:59.916017 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 486/983] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:57:59 2022] POST /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:07.639851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b43baebc-6bb5-41b8-b715-cba72cf25305"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:07.640857 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:07.647464 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:07.647995 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:07.648907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:07.649350 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:07.730833 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: POST /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments HTTP/1.1 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 74 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:58:07.732661 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {"volumeAttachment": {"volumeId": "b43baebc-6bb5-41b8-b715-cba72cf25305"}} Jun 28 17:58:07.734188 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'server_id': 'e1f815c1-f020-40b6-b538-ab3bde233a05', 'body': {'volumeAttachment': {'volumeId': 'b43baebc-6bb5-41b8-b715-cba72cf25305'}}} Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:07.735097 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:07.736653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 400 to user: Invalid volume: volume b43baebc-6bb5-41b8-b715-cba72cf25305 is already attached to instances: e1f815c1-f020-40b6-b538-ab3bde233a05 {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1f95e2ee-3d70-4d96-a9ce-68e19a961384 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099227 Jun 28 17:58:07.737938 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 498/984] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:58:07 2022] POST /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 17:58:07.797484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:07.798070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:07.805230 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:07.805667 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:07.806439 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:07.806876 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:07.902544 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lazy-loading 'services' on Instance uuid e1f815c1-f020-40b6-b538-ab3bde233a05 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:58:07.982466 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c9840bdf-1655-4ed6-9979-3de53f554b98 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments/b43baebc-6bb5-41b8-b715-cba72cf25305" status: 202 len: 0 microversion: 2.1 time: 0.189111 Jun 28 17:58:07.983297 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 487/985] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:58:07 2022] DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments/b43baebc-6bb5-41b8-b715-cba72cf25305 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:58:07.992121 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:07.993403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:08.000693 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.001447 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.002394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.003011 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.038409 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-e48d990e-d70a-46f8-92a2-034978b435e7 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Jun 28 17:58:08.039091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 499/986] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:58:07 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:08.648572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-03834e18-cf10-487f-962b-f314c2a7d6c8 req-cd28fef2-5d3e-45f1-97af-cd4aa5274224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:08.651643 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:08.652360 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:08.662592 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.663149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.664178 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.664831 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.665029 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-03834e18-cf10-487f-962b-f314c2a7d6c8 req-cd28fef2-5d3e-45f1-97af-cd4aa5274224 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.665289 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-03834e18-cf10-487f-962b-f314c2a7d6c8 req-cd28fef2-5d3e-45f1-97af-cd4aa5274224 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.681378 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-03834e18-cf10-487f-962b-f314c2a7d6c8 req-cd28fef2-5d3e-45f1-97af-cd4aa5274224 service nova] Creating event network-changed:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:58:08.688758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-03834e18-cf10-487f-962b-f314c2a7d6c8 req-cd28fef2-5d3e-45f1-97af-cd4aa5274224 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043471 Jun 28 17:58:08.689576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 500/987] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:08.692875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:58:08.815487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c367923e-02aa-4dcd-abd2-946952534f5f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 204 len: 0 microversion: 2.1 time: 0.173378 Jun 28 17:58:08.820886 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 488/988] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:58:08 2022] DELETE /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:58:08.829824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:08.831782 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:08.840891 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.841594 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:08.846852 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:08.847911 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:09.024354 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:09.032430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c354d012-3f20-440a-9163-dcac78b38c2d tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.207016 Jun 28 17:58:09.033141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 501/989] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:08 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:09.051646 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:09.052924 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:09.059811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:09.060359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:09.061296 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:09.061815 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:09.094227 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d6d4a415-3bbf-4728-bb0e-59bf807d20d9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Jun 28 17:58:09.094916 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 489/990] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:58:09 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:10.050859 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:10.051659 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:10.060309 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.060795 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.062713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.063283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.106824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:10.107832 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:10.114971 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.115498 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.116431 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.116872 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.146895 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-97efe8ab-12cb-4206-8056-fd184cf10798 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044014 Jun 28 17:58:10.147555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 490/991] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:58:10 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:58:10.208875 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:10.209375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:10.215595 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.216077 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.216880 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.217318 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.237711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:10.243702 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:58:10.245758 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1b169b74-c1cb-48fa-a0f8-f416ae699874 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.198857 Jun 28 17:58:10.246324 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 502/992] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:10 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:10.340294 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3369b022-5829-4afc-8902-14b27de41011 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 204 len: 0 microversion: 2.1 time: 0.128268 Jun 28 17:58:10.340294 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 491/993] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:58:10 2022] DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:58:10.342198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:10.342899 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:10.350264 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.350802 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.351769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:10.352201 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:10.566423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:10.574684 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6dde577e-fb60-4074-97dc-00e791f295d5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1681 microversion: 2.1 time: 0.236522 Jun 28 17:58:10.575486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 503/994] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:10 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:11.266462 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:11.267551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:11.277937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:11.278569 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:11.279648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:11.280258 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:11.440707 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:11.448868 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-4735f58f-1f1f-40ac-bdf5-662224ce536f tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1570 microversion: 2.1 time: 0.188894 Jun 28 17:58:11.449449 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 492/995] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:11 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:11.593049 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:11.594562 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:11.603201 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:11.603762 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:11.604642 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:11.605026 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:11.747960 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:11.758769 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-75c96f0b-8996-465e-bf2d-1f9bf7b302f5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1681 microversion: 2.1 time: 0.169441 Jun 28 17:58:11.759576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 504/996] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:11 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:12.468676 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:12.469302 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:12.476428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:12.477295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:12.478070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:12.478497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:12.500729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-cd79f7dd-031e-403c-a6be-c907a1d6e383 req-09824bd9-b4dd-4cf0-b4de-032fa39d73e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32788ad3-0665-4176-82a1-ff9cb3c74952", "name": "network-vif-deleted", "tag": "2c099973-2dcd-4074-99ad-66b15de47083"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:12.509146 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-cd79f7dd-031e-403c-a6be-c907a1d6e383 req-09824bd9-b4dd-4cf0-b4de-032fa39d73e8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:12.509698 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-cd79f7dd-031e-403c-a6be-c907a1d6e383 req-09824bd9-b4dd-4cf0-b4de-032fa39d73e8 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:12.521814 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-cd79f7dd-031e-403c-a6be-c907a1d6e383 req-09824bd9-b4dd-4cf0-b4de-032fa39d73e8 service nova] Creating event network-vif-deleted:2c099973-2dcd-4074-99ad-66b15de47083 for instance 32788ad3-0665-4176-82a1-ff9cb3c74952 on hv-cinder-84801 Jun 28 17:58:12.527274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-cd79f7dd-031e-403c-a6be-c907a1d6e383 req-09824bd9-b4dd-4cf0-b4de-032fa39d73e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030118 Jun 28 17:58:12.528493 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 505/997] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:12.595729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8021cab94c8545b2bb9b202b08ce5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01df3376f07f4e38b6ad42b030711f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:12.604762 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-f573c051-2aa2-4f43-b31e-2ecd1126d552 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 200 len: 1383 microversion: 2.1 time: 0.141783 Jun 28 17:58:12.614349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 493/998] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:12 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 1383 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:12.778960 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:12.780613 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:12.789685 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:12.790408 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:12.791424 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:12.792077 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:12.872164 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:12.881697 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4af53f19-a445-407e-8b82-dce8a34482d2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1614 microversion: 2.1 time: 0.106985 Jun 28 17:58:12.891474 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 506/999] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:12 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:13.116290 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-3b0d3242-99c3-4fbd-9531-bb910a12d99e req-616cbea9-7863-4ad2-a455-c7743ee33e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f815c1-f020-40b6-b538-ab3bde233a05", "name": "network-vif-deleted", "tag": "128ee9eb-235f-43f7-8cd9-b93c0f96fcbd"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:13.124609 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-3b0d3242-99c3-4fbd-9531-bb910a12d99e req-616cbea9-7863-4ad2-a455-c7743ee33e31 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.125051 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-3b0d3242-99c3-4fbd-9531-bb910a12d99e req-616cbea9-7863-4ad2-a455-c7743ee33e31 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.137265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-3b0d3242-99c3-4fbd-9531-bb910a12d99e req-616cbea9-7863-4ad2-a455-c7743ee33e31 service nova] Creating event network-vif-deleted:128ee9eb-235f-43f7-8cd9-b93c0f96fcbd for instance e1f815c1-f020-40b6-b538-ab3bde233a05 on hv-cinder-84801 Jun 28 17:58:13.142682 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-3b0d3242-99c3-4fbd-9531-bb910a12d99e req-616cbea9-7863-4ad2-a455-c7743ee33e31 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030287 Jun 28 17:58:13.143293 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 494/1000] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:13.622016 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:13.622528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] [instance: 32788ad3-0665-4176-82a1-ff9cb3c74952] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:13.629851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.630334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.631123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.631559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.647041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] HTTP exception thrown: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Request method failure captured: Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 HTTP/1.1 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0AfjjGUVCd_NGINRRhD9T1LYkz6ad2EIOTjSvECEZLrcMdna43vQ_mD4UK2Ql5pe8p-qkDDCeZd1BXPduM3uqDMBXRewTyzBM7k0C0N6kZ8G8vwWXxl_PL93OUdSKw9ZmnksB2i2NhKw7omEvOAMj3bEdRswPJfbTYR2SbnAFnahyc Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 01df3376f07f4e38b6ad42b030711f72 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-TestShelveInstance-166559508 Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:58:13.648897 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01df3376f07f4e38b6ad42b030711f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_01df3376f07f4e38b6ad42b030711f72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/01df3376f07f4e38b6ad42b030711f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01df3376f07f4e38b6ad42b030711f72"}]}] Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-TestShelveInstance-166559508 Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 01df3376f07f4e38b6ad42b030711f72 Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-TestShelveInstance-166559508 Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-TestShelveInstance-166559508-project Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 8021cab94c8545b2bb9b202b08ce5cc4 Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-TestShelveInstance-166559508-project Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. Jun 28 17:58:13.650574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '32788ad3-0665-4176-82a1-ff9cb3c74952'} Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:58:13.654893 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. Jun 28 17:58:13.656176 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:58:13.657895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Returning 404 to user: Instance 32788ad3-0665-4176-82a1-ff9cb3c74952 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:58:13.657895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8d6465b2-f116-4183-a884-b60ebb9e0436 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952" status: 404 len: 111 microversion: 2.1 time: 0.032429 Jun 28 17:58:13.657895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 507/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:13 2022] GET /compute/v2.1/servers/32788ad3-0665-4176-82a1-ff9cb3c74952 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:58:13.845769 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-972664ec-aad3-4d07-95b2-755d1b0d9540 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] Calling method '.version_select at 0x7f57728b3ca0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:13.867743 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-972664ec-aad3-4d07-95b2-755d1b0d9540 tempest-TestShelveInstance-166559508 tempest-TestShelveInstance-166559508-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-164806118" status: 202 len: 0 microversion: 2.1 time: 0.027039 Jun 28 17:58:13.869011 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 495/1002] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-164806118 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:58:13.899996 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:13.901278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:13.907979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.908696 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.909748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.910313 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.945620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:13.946068 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:13.946524 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.objects.instance [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lazy-loading 'fault' on Instance uuid e1f815c1-f020-40b6-b538-ab3bde233a05 {{(pid=124336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:58:14.038171 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:14.046726 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a9634099-8fe8-4afd-b18f-9ecc1b9e6d70 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 200 len: 1332 microversion: 2.1 time: 0.150548 Jun 28 17:58:14.056569 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 508/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:13 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:15.064906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:15.065730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:15.073780 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:15.074235 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:15.075024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:15.075474 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:15.093941 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 HTTP/1.1 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:58:15.095617 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:58:15.097726 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'e1f815c1-f020-40b6-b538-ab3bde233a05'} Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:58:15.098574 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:58:15.100358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:58:15.101786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:58:15.101786 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a8d6f924-934a-4a72-b7db-329344dd28ca tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 404 len: 111 microversion: 2.1 time: 0.036979 Jun 28 17:58:15.102760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 496/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:15 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:58:15.107879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d32589d4-ca2d-4d6b-bdbc-a147a1386d91 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '.version_select at 0x7f577250db80>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:15.128156 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d32589d4-ca2d-4d6b-bdbc-a147a1386d91 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588619277" status: 202 len: 0 microversion: 2.1 time: 0.024024 Jun 28 17:58:15.128774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 509/1005] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 28 17:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588619277 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:58:15.825524 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b29dbcb2-d9b5-495f-b262-a1deb10fa820 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: .version_select at 0x7f57720400d0>, body: {"keypair": {"name": "tempest-keypair-1493140939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEwokwXT3WUDrPVnAZkx4IYWL8inhPo/ktxkkEqOah3ynFMLikppdos0DJoBFVKELp3h4LUQUF4K3RhC0oXQoZHiXuNFmst8PwPPzsBTfe2YTP83d1DwkCqzcVRKQpJCg=="}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:15.845533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-b29dbcb2-d9b5-495f-b262-a1deb10fa820 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:58:15.852288 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-b29dbcb2-d9b5-495f-b262-a1deb10fa820 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'key_pairs'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:58:15.884551 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b29dbcb2-d9b5-495f-b262-a1deb10fa820 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063747 Jun 28 17:58:15.885453 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 497/1006] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 28 17:58:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:17.365710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1507428238", "imageRef": "0389d765-8047-4c9b-86ed-ae7a7c313947", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ef5600c-56fb-4e68-a629-2bbbc31b7dae"}], "security_groups": [{"name": "tempest-securitygroup--1639303777"}], "key_name": "tempest-keypair-1493140939", "user_data": "}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:17.486788 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.network.neutron [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] validate_networks() for [('3ef5600c-56fb-4e68-a629-2bbbc31b7dae', None, None, None, None, None)] {{(pid=124336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:58:17.914639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:58:17.915210 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image limits 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:58:17.915886 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Flavor pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:58:17.916497 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Image pref 0:0:0 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:58:17.917138 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.virt.hardware [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:58:17.928945 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:17.929426 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:17.930222 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:17.930653 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:17.947720 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:58:17.951958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.quota [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Getting quotas for user d2a47a589b6147019931fb35b330831e and project 1a9ae2f597a94227898ea7da732db6a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:58:17.964590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Going to run 1 instances... {{(pid=124336) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:58:17.967019 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0389d765-8047-4c9b-86ed-ae7a7c313947',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:58:18.014406 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-dcbd7a46-1152-418f-b329-4b632cdc097f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656678 Jun 28 17:58:18.015247 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 510/1007] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:58:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:58:18.025925 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-34785191-cbf2-494e-b749-e62ae53edabe tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:18.027161 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-34785191-cbf2-494e-b749-e62ae53edabe tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:18.099143 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-34785191-cbf2-494e-b749-e62ae53edabe tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:18.107012 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-34785191-cbf2-494e-b749-e62ae53edabe tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1242 microversion: 2.1 time: 0.085460 Jun 28 17:58:18.107722 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 498/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:18 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:19.127671 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:19.129450 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:19.138167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:19.139170 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:19.140792 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:19.141430 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:19.252576 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:19.262166 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f089c831-d9ff-435b-9063-e30c44ba4475 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1312 microversion: 2.1 time: 0.140972 Jun 28 17:58:19.263296 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 511/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:19 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:20.280031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:20.280625 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:20.290335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:20.291910 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:20.292883 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:20.293330 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:20.426694 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:20.440847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2c1b407d-130a-463e-a226-6f7f6e7b120e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1300 microversion: 2.1 time: 0.160371 Jun 28 17:58:20.440847 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 499/1010] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:20 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:21.459974 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:21.462091 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:21.471127 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:21.472128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:21.473596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:21.474193 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:21.667094 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:21.678097 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-678a6dbc-90cb-4c95-a152-a43bee391d38 req-ada634ef-5221-43df-9831-8ca3a68c23ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3", "tag": "45c8ee98-bb6c-4dc6-90d5-a000a2d5708c"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:21.698036 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-678a6dbc-90cb-4c95-a152-a43bee391d38 req-ada634ef-5221-43df-9831-8ca3a68c23ad service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:21.699272 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-678a6dbc-90cb-4c95-a152-a43bee391d38 req-ada634ef-5221-43df-9831-8ca3a68c23ad service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:21.710478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-396b982b-4b26-4ea3-949f-930380e0885c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.255430 Jun 28 17:58:21.716615 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-678a6dbc-90cb-4c95-a152-a43bee391d38 req-ada634ef-5221-43df-9831-8ca3a68c23ad service nova] Creating event network-changed:45c8ee98-bb6c-4dc6-90d5-a000a2d5708c for instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 on hv-cinder-84801 Jun 28 17:58:21.722589 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-678a6dbc-90cb-4c95-a152-a43bee391d38 req-ada634ef-5221-43df-9831-8ca3a68c23ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049494 Jun 28 17:58:21.723494 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 512/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:21 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:21.733811 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 500/1012] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:22.727302 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:22.728128 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:22.741403 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:22.741711 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:22.742472 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:22.742908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:22.894752 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:22.903151 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5c068e97-bb9f-4872-b7be-9f4c687cc3c3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.179798 Jun 28 17:58:22.903749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 513/1013] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:22 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:23.922355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:23.923037 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:23.929806 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:23.930277 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:23.931057 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:23.931484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:24.079041 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:24.086907 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-64f485be-0f4a-4f87-8685-3a0ea874d004 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.169280 Jun 28 17:58:24.087491 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 501/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:23 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:25.103494 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:25.104100 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:25.111261 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:25.111713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:25.112518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:25.113628 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:25.254983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:25.265028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5e190985-c673-463e-9f11-f3916af61356 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.165333 Jun 28 17:58:25.265871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 514/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:25 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:26.243271 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-54139c87-f0a8-456e-806c-21fd12d7e06b req-7a802be7-7135-46aa-9edd-282f87165ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3", "name": "network-vif-plugged", "status": "completed", "tag": "45c8ee98-bb6c-4dc6-90d5-a000a2d5708c"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:26.252712 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-54139c87-f0a8-456e-806c-21fd12d7e06b req-7a802be7-7135-46aa-9edd-282f87165ed4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:26.253408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-54139c87-f0a8-456e-806c-21fd12d7e06b req-7a802be7-7135-46aa-9edd-282f87165ed4 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:26.258295 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:26.267093 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-54139c87-f0a8-456e-806c-21fd12d7e06b req-7a802be7-7135-46aa-9edd-282f87165ed4 service nova] Creating event network-vif-plugged:45c8ee98-bb6c-4dc6-90d5-a000a2d5708c for instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 on hv-cinder-84801 Jun 28 17:58:26.272020 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-54139c87-f0a8-456e-806c-21fd12d7e06b req-7a802be7-7135-46aa-9edd-282f87165ed4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032606 Jun 28 17:58:26.272653 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 502/1016] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 17:58:26.282431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:26.283048 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:26.289712 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:26.290160 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:26.290929 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:26.291542 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:26.446993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:26.454710 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-88855704-83f7-4a76-b222-a78630df7892 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.176190 Jun 28 17:58:26.455278 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 515/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:26 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:27.476210 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:27.476977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:27.486957 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:27.487549 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:27.488497 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:27.488936 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:27.653464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:27.664353 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a227a94f-771a-4005-b591-35f3c9374898 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1368 microversion: 2.1 time: 0.195065 Jun 28 17:58:27.665114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 503/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:27 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:28.682593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:28.683405 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:28.686478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:28.687364 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=6 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:28.688141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:28.695096 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:28.695551 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:28.696327 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:28.696796 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:28.700556 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=93 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:28.852713 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:58:28.861851 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-65e65658-4498-4320-b6c6-6ce3cde54841 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1557 microversion: 2.1 time: 0.183402 Jun 28 17:58:28.862441 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 516/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:58:28 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1557 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:58:28.879656 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:58:28.880268 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:58:28.882211 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:28.889019 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:28.889468 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:28.890257 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:28.890699 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:28.986561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e2ee85cf-e240-4007-8cf4-aa3564cc3ffd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111455 Jun 28 17:58:28.987183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 504/1020] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 28 17:58:28 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:58:30.268270 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-bd78f41a-d258-413c-be60-bbc22fdc0fe9 req-ceb7e0a2-6d26-4d1e-b70b-1c7de69ec1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3", "tag": "45c8ee98-bb6c-4dc6-90d5-a000a2d5708c"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:58:30.277970 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-bd78f41a-d258-413c-be60-bbc22fdc0fe9 req-ceb7e0a2-6d26-4d1e-b70b-1c7de69ec1b3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:58:30.278419 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-bd78f41a-d258-413c-be60-bbc22fdc0fe9 req-ceb7e0a2-6d26-4d1e-b70b-1c7de69ec1b3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:58:30.289963 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-bd78f41a-d258-413c-be60-bbc22fdc0fe9 req-ceb7e0a2-6d26-4d1e-b70b-1c7de69ec1b3 service nova] Creating event network-changed:45c8ee98-bb6c-4dc6-90d5-a000a2d5708c for instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 on hv-cinder-84801 Jun 28 17:58:30.295113 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-bd78f41a-d258-413c-be60-bbc22fdc0fe9 req-ceb7e0a2-6d26-4d1e-b70b-1c7de69ec1b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030538 Jun 28 17:58:30.295806 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 517/1021] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:01.518421 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:01.519229 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=10 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:01.523889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:01.524408 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:01.532812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:01.533265 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:01.534035 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:01.534473 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:01.559977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3a213008-5a97-4bd7-8b01-e73b942b7ac3 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/ips" status: 200 len: 148 microversion: 2.1 time: 0.043120 Jun 28 17:59:01.560582 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 505/1022] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:59:01 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:02.924994 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=3 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:02.925748 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=7 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:02.930355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c6f70d4-459f-40a1-b829-2b438380f2ab"}} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:02.931505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:02.938808 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:02.939258 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:02.940054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:02.940528 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:03.230652 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-439a8f4a-3ecb-4d0f-b9fc-d3cb3af7487a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "POST /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307107 Jun 28 17:59:03.231525 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 518/1023] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 28 17:59:02 2022] POST /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:10.904316 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:10.904906 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:10.913741 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:10.914192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:10.915347 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:10.915979 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:11.004029 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.objects.instance [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lazy-loading 'services' on Instance uuid de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 {{(pid=124337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 17:59:11.083623 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-906ff18e-0751-40dd-97a8-cea45bf71042 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments/1c6f70d4-459f-40a1-b829-2b438380f2ab" status: 202 len: 0 microversion: 2.1 time: 0.184932 Jun 28 17:59:11.084336 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 506/1024] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 28 17:59:10 2022] DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments/1c6f70d4-459f-40a1-b829-2b438380f2ab => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:59:11.094484 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:11.095633 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:11.102366 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:11.102882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:11.103734 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:11.104216 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:11.135615 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-488db5ad-1a9b-4d95-a45b-512d791c87a1 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Jun 28 17:59:11.136197 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 519/1025] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:59:11 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:12.149555 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:12.150517 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:12.157809 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.158359 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.159136 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.159572 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.189932 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-547033e8-9e7b-4fca-a43b-73b7131affe0 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044778 Jun 28 17:59:12.190527 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 507/1026] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 28 17:59:12 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 17:59:12.253061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:12.253669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:12.260884 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.261340 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.262443 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.262907 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.291429 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Going to try to terminate instance {{(pid=124336) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 17:59:12.373939 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-1833ee2b-e4da-4f8d-8e17-eed7dcc4a79e tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 204 len: 0 microversion: 2.1 time: 0.126670 Jun 28 17:59:12.374623 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 520/1027] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:59:12 2022] DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 17:59:12.383824 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:12.384470 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:12.391030 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.391486 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.392314 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:12.392793 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:12.549632 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:12.558139 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b5813edc-bbb6-4af5-84c5-641d644233c8 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1681 microversion: 2.1 time: 0.178901 Jun 28 17:59:12.558715 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 508/1028] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:12 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:59:13.579059 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:13.579766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:13.587018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:13.587477 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:13.588238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:13.588737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:13.725669 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:13.734692 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d510b3dd-e481-4497-ba30-7da527c3befa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1681 microversion: 2.1 time: 0.159900 Jun 28 17:59:13.735284 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 521/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:13 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:14.754037 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:14.754859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:14.762412 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:14.762878 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:14.763666 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:14.764125 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:14.854688 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2a47a589b6147019931fb35b330831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9ae2f597a94227898ea7da732db6a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:14.863015 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-3f232cf6-4e3f-4ca1-90fd-8c979067848a tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 200 len: 1613 microversion: 2.1 time: 0.113167 Jun 28 17:59:14.863619 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 509/1030] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:14 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:14.937882 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-fdaa91d5-3f1a-4290-bf24-9ca6d6415193 req-5c3c792c-2218-4433-8b0c-84ddabd26146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3", "name": "network-vif-deleted", "tag": "45c8ee98-bb6c-4dc6-90d5-a000a2d5708c"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:14.947873 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-fdaa91d5-3f1a-4290-bf24-9ca6d6415193 req-5c3c792c-2218-4433-8b0c-84ddabd26146 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:14.948329 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-fdaa91d5-3f1a-4290-bf24-9ca6d6415193 req-5c3c792c-2218-4433-8b0c-84ddabd26146 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:14.962083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-fdaa91d5-3f1a-4290-bf24-9ca6d6415193 req-5c3c792c-2218-4433-8b0c-84ddabd26146 service nova] Creating event network-vif-deleted:45c8ee98-bb6c-4dc6-90d5-a000a2d5708c for instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 on hv-cinder-84801 Jun 28 17:59:14.968593 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-fdaa91d5-3f1a-4290-bf24-9ca6d6415193 req-5c3c792c-2218-4433-8b0c-84ddabd26146 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Jun 28 17:59:14.969400 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 522/1031] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:15.881939 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:15.882729 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:15.890859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:15.891454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:15.892105 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:15.892686 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:15.908130 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 HTTP/1.1 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:59:15.909842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:15.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3'} Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:15.912680 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:15.914256 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:15.915849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:15.915849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-81b4dc20-c6db-48a1-98ce-eb35349e805d tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 404 len: 111 microversion: 2.1 time: 0.033816 Jun 28 17:59:15.915849 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 510/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:15 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:15.921238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d21fe05c-29e6-49d4-8653-0dd679072f10 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '.version_select at 0x7f577241b040>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:15.941274 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d21fe05c-29e6-49d4-8653-0dd679072f10 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493140939" status: 202 len: 0 microversion: 2.1 time: 0.024152 Jun 28 17:59:15.942283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 523/1033] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 28 17:59:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493140939 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:59:18.815499 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:18.816054 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:18.823056 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:18.823508 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:18.824281 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:18.824749 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:18.838340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 HTTP/1.1 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:59:18.839899 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.841535 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3'} Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:18.842399 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.843731 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.846059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:18.846059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-10a0fa29-5449-4389-a292-7e4220073da5 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 404 len: 111 microversion: 2.1 time: 0.029953 Jun 28 17:59:18.846059 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 511/1034] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:59:18 2022] DELETE /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:18.850766 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:18.851732 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:18.859810 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:18.860252 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:18.861137 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:18.861571 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:18.880815 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 HTTP/1.1 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:18.883054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.884786 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3'} Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:18.885722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. Jun 28 17:59:18.887635 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:18.888993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:18.888993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-79e92a24-aba3-43e0-9800-b78308e38d2f tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3" status: 404 len: 111 microversion: 2.1 time: 0.038259 Jun 28 17:59:18.888993 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 524/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:18 2022] GET /compute/v2.1/servers/de5ad6f9-d41a-46d5-a15f-0e5ec5fac5a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:20.038472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:20.039111 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:20.045984 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.046411 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.047181 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.047704 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.063011 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 HTTP/1.1 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:59:20.064649 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.067343 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': 'e1f815c1-f020-40b6-b538-ab3bde233a05'} Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:20.069149 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.071900 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.074789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:20.074789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5bff3985-fd8b-4544-a5c8-955d8653c3a9 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 404 len: 111 microversion: 2.1 time: 0.038190 Jun 28 17:59:20.074789 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 512/1036] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:59:20 2022] DELETE /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:20.075604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:20.076311 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e1f815c1-f020-40b6-b538-ab3bde233a05] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:20.083124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.083580 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.084421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.085044 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.099596 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 HTTP/1.1 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:20.101355 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.103028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'e1f815c1-f020-40b6-b538-ab3bde233a05'} Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:20.103910 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. Jun 28 17:59:20.105508 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.106863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e1f815c1-f020-40b6-b538-ab3bde233a05 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:20.106863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f31a1051-9ae2-415a-acf0-ec16711e525c tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05" status: 404 len: 111 microversion: 2.1 time: 0.031163 Jun 28 17:59:20.106863 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 525/1037] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:20 2022] GET /compute/v2.1/servers/e1f815c1-f020-40b6-b538-ab3bde233a05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:20.114157 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:20.114854 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:20.123687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.124278 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.125386 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.126008 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.142122 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 HTTP/1.1 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:59:20.143693 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.145245 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '980b95d7-3d7f-4e39-a5f3-87d473488328'} Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:20.146070 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.147479 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.148889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:20.148889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-573e564a-14e8-46d9-a346-a2bff4d48cfa tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 404 len: 111 microversion: 2.1 time: 0.037130 Jun 28 17:59:20.148889 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 513/1038] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:59:20 2022] DELETE /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:20.154924 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:20.155620 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: 980b95d7-3d7f-4e39-a5f3-87d473488328] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:20.162124 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.162774 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.163391 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:20.163829 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:20.178651 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 HTTP/1.1 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:20.180250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.182179 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '980b95d7-3d7f-4e39-a5f3-87d473488328'} Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:20.183437 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. Jun 28 17:59:20.185055 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:20.186574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance 980b95d7-3d7f-4e39-a5f3-87d473488328 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:20.186574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-2ac7ea9a-1595-4700-bff4-14414d7a79dd tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328" status: 404 len: 111 microversion: 2.1 time: 0.030820 Jun 28 17:59:20.186574 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 526/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:20 2022] GET /compute/v2.1/servers/980b95d7-3d7f-4e39-a5f3-87d473488328 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:22.282597 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-993333733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-226535126", "security_groups": [{"name": "tempest-secgroup-smoke-2079568724"}], "block_device_mapping_v2": [{"uuid": "0f60c1d9-16aa-42d7-a7cc-15ca38512d19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906f2279-ce2e-4008-b2c1-0164dd91965f"}]}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:22.402637 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:22.403406 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:22.406912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.network.neutron [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] validate_networks() for [('906f2279-ce2e-4008-b2c1-0164dd91965f', None, None, None, None, None)] {{(pid=124337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 17:59:22.410022 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:22.410485 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:22.411368 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:22.411807 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:22.429879 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b HTTP/1.1 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:22.431657 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.433448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'e5fa4296-b2b9-4a76-9b97-af72ea6edd3b'} Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:22.437214 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.438965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.440513 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:22.440513 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9e92872b-16f2-4d60-b1b0-63ebd728e4b2 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 404 len: 111 microversion: 2.1 time: 0.034547 Jun 28 17:59:22.440513 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 527/1040] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 17:59:22 2022] DELETE /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:59:22.442076 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:22.442686 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] [instance: e5fa4296-b2b9-4a76-9b97-af72ea6edd3b] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:22.449431 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:22.449876 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:22.450649 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:22.451053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:22.466104 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] HTTP exception thrown: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Request method failure captured: Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b HTTP/1.1 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0B7kEDoHgeba7Wm6M6zIPI4vZp61N_nGkUHnVwhPJslEiHPK_IbsEe1g1t8U4p5QuKpXq-2x4lg4VUDHNRICjQAd4yWHTFyZ1AutSuzO1qZJyP7aKchCUJFhrqOq0H-w3Uai8IkkJn06RQkSb8YbX48mZK4Hzy0HoIjYoWsgb6s1fA Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:22.467573 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a9ae2f597a94227898ea7da732db6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a9ae2f597a94227898ea7da732db6a4"}]}] Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 1a9ae2f597a94227898ea7da732db6a4 Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1576888043 Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: d2a47a589b6147019931fb35b330831e Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-AttachVolumeNegativeTest-1576888043-project Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.469294 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'e5fa4296-b2b9-4a76-9b97-af72ea6edd3b'} Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:22.470215 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. Jun 28 17:59:22.471741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:22.473145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] Returning 404 to user: Instance e5fa4296-b2b9-4a76-9b97-af72ea6edd3b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:22.473145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-61b9ea1d-a704-4234-bf8d-a0b91b4b00f6 tempest-AttachVolumeNegativeTest-1576888043 tempest-AttachVolumeNegativeTest-1576888043-project] 10.222.0.43 "GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b" status: 404 len: 111 microversion: 2.1 time: 0.030956 Jun 28 17:59:22.473145 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 528/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:22 2022] GET /compute/v2.1/servers/e5fa4296-b2b9-4a76-9b97-af72ea6edd3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 17:59:23.295802 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 17:59:23.296335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image limits 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 17:59:23.296812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Flavor pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 17:59:23.297382 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Image pref 0:0:0 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 17:59:23.297901 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.virt.hardware [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 17:59:23.308033 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:23.308523 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:23.309335 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:23.309775 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:23.329760 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 17:59:23.333701 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.quota [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Getting quotas for user 03f29e8a281f4a2ab15342314d6968d3 and project 8a44949af40746b4af7f2acd60b73cba. Resources: {'cores', 'instances', 'ram'} {{(pid=124337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 17:59:23.396648 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Going to run 1 instances... {{(pid=124337) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 17:59:23.399120 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f60c1d9-16aa-42d7-a7cc-15ca38512d19',volume_size=None,volume_type=None)] {{(pid=124337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 17:59:23.591191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-bd0b47ea-0d92-483a-85ff-a95977e5d027 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.312400 Jun 28 17:59:23.599368 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 514/1042] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 28 17:59:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 17:59:23.610928 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-85694a12-1373-4884-b2b4-898799aa7b31 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:23.612310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-85694a12-1373-4884-b2b4-898799aa7b31 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:23.704299 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-85694a12-1373-4884-b2b4-898799aa7b31 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:23.711516 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-85694a12-1373-4884-b2b4-898799aa7b31 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1093 microversion: 2.1 time: 0.104665 Jun 28 17:59:23.712095 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 529/1043] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:23 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:24.729135 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:24.729719 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:24.740973 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:24.742561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:24.743370 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:24.743812 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:24.868344 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:24.876215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-900e2cb7-ab64-422a-8725-f9a3aa90e3e3 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1209 microversion: 2.1 time: 0.151612 Jun 28 17:59:24.876912 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 515/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:24 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:25.895934 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:25.896904 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:25.918053 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:25.918518 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:25.920236 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:25.920983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:26.169232 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:26.180648 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-120a2e61-d8ef-4afe-b712-10a6650927d6 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.289351 Jun 28 17:59:26.181564 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 530/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:25 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:26.687798 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-12578360-4577-478f-a181-3887d12e884d req-486150da-4b3d-4973-844b-4e378ccd8dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1a2931-723f-4494-b4ee-1a03eb7a6011", "tag": "146eaf31-f5ed-406c-bb33-c568119d87c0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:26.714628 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-12578360-4577-478f-a181-3887d12e884d req-486150da-4b3d-4973-844b-4e378ccd8dc0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:26.715754 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-12578360-4577-478f-a181-3887d12e884d req-486150da-4b3d-4973-844b-4e378ccd8dc0 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:26.734612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-12578360-4577-478f-a181-3887d12e884d req-486150da-4b3d-4973-844b-4e378ccd8dc0 service nova] Creating event network-changed:146eaf31-f5ed-406c-bb33-c568119d87c0 for instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 on hv-cinder-84801 Jun 28 17:59:26.746464 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-12578360-4577-478f-a181-3887d12e884d req-486150da-4b3d-4973-844b-4e378ccd8dc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073699 Jun 28 17:59:26.747512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 516/1046] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:27.198310 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:27.199130 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:27.206028 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:27.206456 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:27.207250 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:27.207715 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:27.385448 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:27.397587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7c9d90e0-eeaf-47bd-8a70-401a4d2973f4 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.202639 Jun 28 17:59:27.400090 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 531/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:27 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:27.753500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b7bd9b10-ff12-45a5-bb89-30028145a7fc tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Action: 'create', calling method: .version_select at 0x7f577206b670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1880736355"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:28.087585 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b7bd9b10-ff12-45a5-bb89-30028145a7fc tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.468438 Jun 28 17:59:28.088220 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 517/1048] 10.222.0.43 () {60 vars in 1154 bytes} [Tue Jun 28 17:59:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 470 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 28 17:59:28.100014 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-bc3792e0-6f54-460e-a493-4e587744abb9 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5773f9fdc0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:28.153587 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-bc3792e0-6f54-460e-a493-4e587744abb9 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 200 len: 345 microversion: 2.1 time: 0.057440 Jun 28 17:59:28.154167 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 532/1049] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:59:28 2022] GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:28.416739 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:28.417472 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:28.425191 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:28.425703 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:28.426521 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:28.426986 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:28.571807 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:28.580966 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a7451062-e5a8-46c2-940b-a35df4555c16 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.168459 Jun 28 17:59:28.581554 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 518/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:28 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:29.167492 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-c11eca79-b6a3-4557-b234-644c4a01295f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5772488d30>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:29.224487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-c11eca79-b6a3-4557-b234-644c4a01295f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 200 len: 346 microversion: 2.1 time: 0.061466 Jun 28 17:59:29.225064 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 533/1051] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:59:29 2022] GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:29.237001 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-5793098e-ad2c-49c6-8bd3-a4cbadd2db64 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Action: 'create', calling method: .version_select at 0x7f5772c69940>, body: {"snapshot": {"volume_id": "5f75a65e-1dec-4705-91ad-b4e3586cfd4b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-559133173"}} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:29.400428 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-5793098e-ad2c-49c6-8bd3-a4cbadd2db64 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.167391 Jun 28 17:59:29.401068 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 519/1052] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Jun 28 17:59:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:29.411203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-471773b3-de12-4efa-a37b-b2ca2d86942f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f577256ec10>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:29.443965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-471773b3-de12-4efa-a37b-b2ca2d86942f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.036499 Jun 28 17:59:29.444505 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 534/1053] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:29 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:29.457031 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b5fd794d-9caa-4c4b-ac1d-c1e89b277c56 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5772018280>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:29.493929 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b5fd794d-9caa-4c4b-ac1d-c1e89b277c56 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042806 Jun 28 17:59:29.494489 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 520/1054] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jun 28 17:59:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:29.504824 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-6c8a9f1d-fb0c-42eb-b426-377e9922331c tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f57720aae50>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:29.539141 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-6c8a9f1d-fb0c-42eb-b426-377e9922331c tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.038153 Jun 28 17:59:29.540339 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 535/1055] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:29 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:29.599373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:29.600092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:29.607599 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:29.608039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:29.608869 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:29.609310 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:29.755331 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:29.765772 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a1311cd5-13fd-497a-ae61-18193ae5ebdd tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.171124 Jun 28 17:59:29.766366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 521/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:29 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:30.553718 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-5196b27c-bc43-4a0e-a827-069ef38e9ccc tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f577250d310>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:30.585985 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-5196b27c-bc43-4a0e-a827-069ef38e9ccc tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.036720 Jun 28 17:59:30.586560 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 536/1057] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:30 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:30.783862 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:30.784496 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:30.792366 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:30.792839 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:30.793612 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:30.794039 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:30.940863 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:30.949522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c5a9c0ff-8512-4979-b75f-7489e630f74b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.169507 Jun 28 17:59:30.950100 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 522/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:30 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:31.599731 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-f1239005-0620-4029-9004-c8fe261a1b4c tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f57746ae700>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:31.633203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-f1239005-0620-4029-9004-c8fe261a1b4c tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.037793 Jun 28 17:59:31.633855 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 537/1059] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:31 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:31.967590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:31.968192 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:31.970948 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:31.976985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:31.977581 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:31.978414 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:31.978852 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:31.982116 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:32.120533 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:32.128626 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-a4e6dae6-9a1f-43a9-93b0-a9c986903e07 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.164948 Jun 28 17:59:32.129205 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 523/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:31 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:32.646385 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-631ae9e5-05e0-46ee-ba42-c4747dc79499 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5771f1f5e0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:32.680992 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-631ae9e5-05e0-46ee-ba42-c4747dc79499 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.038553 Jun 28 17:59:32.681805 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 538/1061] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:32 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:33.146534 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:33.147175 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:33.154375 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:33.154848 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:33.155650 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:33.156088 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:33.302989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:33.310964 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-d3f64eed-8fa5-486a-be00-f758f393933b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.168262 Jun 28 17:59:33.311454 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 524/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:33 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:33.698198 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a5ee2699-383e-4d3f-8de3-d6a6a07ae2db tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f577241b310>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:33.709276 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell0:SELECT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:33.729293 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a5ee2699-383e-4d3f-8de3-d6a6a07ae2db tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 287 microversion: 2.1 time: 0.038187 Jun 28 17:59:33.729881 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 539/1063] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:33 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:33.740438 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-c5e0583b-c1ff-4666-b77b-aea062eca24d tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5771fa9c10>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:33.746747 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=2 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:33.747427 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell0:SELECT=6 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:33.813045 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-c5e0583b-c1ff-4666-b77b-aea062eca24d tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 202 len: 0 microversion: 2.1 time: 0.076509 Jun 28 17:59:33.813652 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 525/1064] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jun 28 17:59:33 2022] DELETE /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 17:59:33.822226 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-9d5992d2-bc23-440d-84a7-5670f5cdba9f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f577251ab80>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:33.857394 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-9d5992d2-bc23-440d-84a7-5670f5cdba9f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 200 len: 286 microversion: 2.1 time: 0.039090 Jun 28 17:59:33.857964 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 540/1065] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:33 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:34.329525 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:34.330179 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:34.337120 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:34.337552 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:34.338328 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:34.338745 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:34.478051 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:34.486513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-2a00d653-874c-4b97-adba-c659fb15206b tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.161435 Jun 28 17:59:34.487092 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 526/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:34 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:34.871948 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-adab126d-9501-4a13-be31-e8d681595194 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5771fc8d30>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:34.899256 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-adab126d-9501-4a13-be31-e8d681595194 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] HTTP exception thrown: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-adab126d-9501-4a13-be31-e8d681595194 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Request method failure captured: Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 HTTP/1.1 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0F_v-c68BJeDk-XEI7CNybopOefm0kOZz5-gpAQCkMUl3ry_7pr40YECPEe2bQv9JanYlvtHGyc2iLChS2DYx8i-ZIpPskx4KUcY7ydey-yZFGhHLTwGmscLpfvt1zwzmbFc6uoH5EXfeXY1ZtxSJIVvJ0Eyo53ifm15QcHuychs9E Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:34.901572 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}] Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 7b546dade2fc47f783060554029d0a72 Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '22a58bfd-68b8-4f1f-b0dc-4a3957497081'} Jun 28 17:59:34.903268 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. (HTTP 404) (Request-ID: req-c7a427a8-7f97-4dde-aeb5-42a0c2e2c24e) Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.904312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:34.905719 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 28 17:59:34.907123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. Jun 28 17:59:34.908749 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:34.910729 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-adab126d-9501-4a13-be31-e8d681595194 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Returning 404 to user: Snapshot 22a58bfd-68b8-4f1f-b0dc-4a3957497081 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:34.911608 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-adab126d-9501-4a13-be31-e8d681595194 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081" status: 404 len: 111 microversion: 2.1 time: 0.044288 Jun 28 17:59:34.912190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 541/1067] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 28 17:59:34 2022] GET /compute/v2.1/os-snapshots/22a58bfd-68b8-4f1f-b0dc-4a3957497081 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:34.920663 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b8fd7317-f488-403d-9b14-9ce6db58ed7f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5771fee160>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:35.001093 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b8fd7317-f488-403d-9b14-9ce6db58ed7f tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 202 len: 0 microversion: 2.1 time: 0.084465 Jun 28 17:59:35.006681 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 527/1068] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:59:34 2022] DELETE /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 17:59:35.012590 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-662d16aa-035d-4757-afd2-2ada9967c60d tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f577243fdc0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:35.073023 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-662d16aa-035d-4757-afd2-2ada9967c60d tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 200 len: 345 microversion: 2.1 time: 0.065220 Jun 28 17:59:35.074018 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 542/1069] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:59:35 2022] GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:35.503960 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:35.504618 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:35.511405 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:35.512187 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:35.513164 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:35.513605 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:35.665183 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:35.673392 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e823702b-2b52-467a-a96e-cee2b226f182 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.173902 Jun 28 17:59:35.673958 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 528/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:35 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:36.087175 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7609365c-ff27-44bc-9018-edb2c38350ea tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5772488040>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:36.116922 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-7609365c-ff27-44bc-9018-edb2c38350ea tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] HTTP exception thrown: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7609365c-ff27-44bc-9018-edb2c38350ea tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Request method failure captured: Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b HTTP/1.1 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0F_v-c68BJeDk-XEI7CNybopOefm0kOZz5-gpAQCkMUl3ry_7pr40YECPEe2bQv9JanYlvtHGyc2iLChS2DYx8i-ZIpPskx4KUcY7ydey-yZFGhHLTwGmscLpfvt1zwzmbFc6uoH5EXfeXY1ZtxSJIVvJ0Eyo53ifm15QcHuychs9E Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:36.118908 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}] Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 7b546dade2fc47f783060554029d0a72 Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '5f75a65e-1dec-4705-91ad-b4e3586cfd4b'} Jun 28 17:59:36.120603 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. (HTTP 404) (Request-ID: req-a51513a3-3db4-45ff-904e-dfcb8c4f47cd) Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.122194 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:36.124069 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 17:59:36.125304 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7609365c-ff27-44bc-9018-edb2c38350ea tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Returning 404 to user: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7609365c-ff27-44bc-9018-edb2c38350ea tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 404 len: 109 microversion: 2.1 time: 0.037846 Jun 28 17:59:36.126708 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 543/1071] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:59:36 2022] GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:36.136452 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-548223ef-9177-4266-939e-94222dec7b10 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f57728c8ee0>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:36.165099 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-548223ef-9177-4266-939e-94222dec7b10 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] HTTP exception thrown: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-548223ef-9177-4266-939e-94222dec7b10 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Request method failure captured: Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b HTTP/1.1 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0F_v-c68BJeDk-XEI7CNybopOefm0kOZz5-gpAQCkMUl3ry_7pr40YECPEe2bQv9JanYlvtHGyc2iLChS2DYx8i-ZIpPskx4KUcY7ydey-yZFGhHLTwGmscLpfvt1zwzmbFc6uoH5EXfeXY1ZtxSJIVvJ0Eyo53ifm15QcHuychs9E Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 17:59:36.167326 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}] Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 7b546dade2fc47f783060554029d0a72 Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '5f75a65e-1dec-4705-91ad-b4e3586cfd4b'} Jun 28 17:59:36.169190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. (HTTP 404) (Request-ID: req-a12c19fe-8e13-4014-a2f6-4d2c56a22c29) Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.170500 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 17:59:36.171937 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 17:59:36.173373 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-548223ef-9177-4266-939e-94222dec7b10 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Returning 404 to user: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-548223ef-9177-4266-939e-94222dec7b10 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 404 len: 109 microversion: 2.1 time: 0.037090 Jun 28 17:59:36.174842 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 529/1072] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 28 17:59:36 2022] DELETE /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:36.181169 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7bafb126-36ae-4e77-8dde-4a5c35957f80 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Calling method '.version_select at 0x7f5772115dc0>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:36.212362 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-7bafb126-36ae-4e77-8dde-4a5c35957f80 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] HTTP exception thrown: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7bafb126-36ae-4e77-8dde-4a5c35957f80 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Request method failure captured: Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b HTTP/1.1 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0F_v-c68BJeDk-XEI7CNybopOefm0kOZz5-gpAQCkMUl3ry_7pr40YECPEe2bQv9JanYlvtHGyc2iLChS2DYx8i-ZIpPskx4KUcY7ydey-yZFGhHLTwGmscLpfvt1zwzmbFc6uoH5EXfeXY1ZtxSJIVvJ0Eyo53ifm15QcHuychs9E Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 17:59:36.214383 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4adf6a24016947be9f8b8d2fc167cec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4adf6a24016947be9f8b8d2fc167cec4"}]}] Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 4adf6a24016947be9f8b8d2fc167cec4 Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-461840307 Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 7b546dade2fc47f783060554029d0a72 Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-VolumesSnapshotsTestJSON-461840307-project Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '5f75a65e-1dec-4705-91ad-b4e3586cfd4b'} Jun 28 17:59:36.216203 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. (HTTP 404) (Request-ID: req-1c173bd2-21d1-44da-b681-a4826dceff9a) Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.217360 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 17:59:36.218783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 17:59:36.220238 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-7bafb126-36ae-4e77-8dde-4a5c35957f80 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] Returning 404 to user: Volume 5f75a65e-1dec-4705-91ad-b4e3586cfd4b could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-7bafb126-36ae-4e77-8dde-4a5c35957f80 tempest-VolumesSnapshotsTestJSON-461840307 tempest-VolumesSnapshotsTestJSON-461840307-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b" status: 404 len: 109 microversion: 2.1 time: 0.038503 Jun 28 17:59:36.221682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 544/1073] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 28 17:59:36 2022] GET /compute/v2.1/os-volumes/5f75a65e-1dec-4705-91ad-b4e3586cfd4b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:36.579879 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [req-df4afa54-891f-4bcd-99bb-80e7df3f65e2 req-59be66dd-58ae-4ad0-b2d6-c9891cda02c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1a2931-723f-4494-b4ee-1a03eb7a6011", "name": "network-vif-plugged", "status": "completed", "tag": "146eaf31-f5ed-406c-bb33-c568119d87c0"}]} {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:36.590985 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-df4afa54-891f-4bcd-99bb-80e7df3f65e2 req-59be66dd-58ae-4ad0-b2d6-c9891cda02c7 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:36.591637 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [req-df4afa54-891f-4bcd-99bb-80e7df3f65e2 req-59be66dd-58ae-4ad0-b2d6-c9891cda02c7 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:36.604371 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.compute.server_external_events [req-df4afa54-891f-4bcd-99bb-80e7df3f65e2 req-59be66dd-58ae-4ad0-b2d6-c9891cda02c7 service nova] Creating event network-vif-plugged:146eaf31-f5ed-406c-bb33-c568119d87c0 for instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 on hv-cinder-84801 Jun 28 17:59:36.610685 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [req-df4afa54-891f-4bcd-99bb-80e7df3f65e2 req-59be66dd-58ae-4ad0-b2d6-c9891cda02c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Jun 28 17:59:36.611445 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 530/1074] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 17:59:36.690955 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:36.691575 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:36.693799 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:36.700212 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:36.701233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:36.702041 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:36.702468 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:36.705954 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:36.886444 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:36.892806 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-4bd7883b-88eb-4924-a72d-ff2587f29f88 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.205765 Jun 28 17:59:36.893401 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 545/1075] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:36 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:37.918023 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:37.918853 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:37.925973 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:37.926507 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:37.927363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:37.927956 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:38.070541 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:38.078487 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e743c96c-de56-4206-970a-f257144c38fa tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1265 microversion: 2.1 time: 0.165437 Jun 28 17:59:38.079140 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 531/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:37 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:39.096553 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:39.099825 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:39.105744 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:39.106200 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:39.106983 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:39.107465 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:39.266221 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:39.274423 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-fdfeda43-3e7c-4c38-8947-d0517504d366 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1451 microversion: 2.1 time: 0.181822 Jun 28 17:59:39.275026 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 546/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:39 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 17:59:39.292962 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 17:59:39.293735 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 17:59:39.309892 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:39.310587 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:39.311561 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:39.312075 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:39.488919 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 17:59:39.497537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-7160c20c-9d75-4a26-af6d-6ca0e225268a tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1451 microversion: 2.1 time: 0.208689 Jun 28 17:59:39.498977 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 532/1078] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 17:59:39 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 17:59:41.678757 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-8c54ff47-c9ba-4b4e-af96-f325e47bf189 req-65a939f7-e370-4342-9b6f-4f98058e793c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1a2931-723f-4494-b4ee-1a03eb7a6011", "tag": "146eaf31-f5ed-406c-bb33-c568119d87c0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 17:59:41.688581 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8c54ff47-c9ba-4b4e-af96-f325e47bf189 req-65a939f7-e370-4342-9b6f-4f98058e793c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 17:59:41.689150 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-8c54ff47-c9ba-4b4e-af96-f325e47bf189 req-65a939f7-e370-4342-9b6f-4f98058e793c service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 17:59:41.700965 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-8c54ff47-c9ba-4b4e-af96-f325e47bf189 req-65a939f7-e370-4342-9b6f-4f98058e793c service nova] Creating event network-changed:146eaf31-f5ed-406c-bb33-c568119d87c0 for instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 on hv-cinder-84801 Jun 28 17:59:41.706440 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-8c54ff47-c9ba-4b4e-af96-f325e47bf189 req-65a939f7-e370-4342-9b6f-4f98058e793c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031346 Jun 28 17:59:41.707061 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 547/1079] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 17:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 18:01:10.268896 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_api:SELECT=13 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 18:01:10.270024 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG dbcounter [-] [124337] Writing DB stats nova_cell1:SELECT=37 {{(pid=124337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 18:01:10.273149 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61e9b215-2f23-475a-a697-3173d8576330] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 28 18:01:10.273677 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_api:SELECT=5 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 18:01:10.274540 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG dbcounter [-] [124336] Writing DB stats nova_cell1:SELECT=13 {{(pid=124336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 18:01:10.275015 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:10.275537 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:10.279737 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-be3cce4e-4add-408a-8183-c57a6bc9b452 req-968604e7-c13f-4156-96a4-5f00937e64a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1a2931-723f-4494-b4ee-1a03eb7a6011", "tag": "146eaf31-f5ed-406c-bb33-c568119d87c0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 18:01:10.283115 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:10.283513 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:10.284728 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:10.285215 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:10.289421 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-be3cce4e-4add-408a-8183-c57a6bc9b452 req-968604e7-c13f-4156-96a4-5f00937e64a9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:10.289871 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-be3cce4e-4add-408a-8183-c57a6bc9b452 req-968604e7-c13f-4156-96a4-5f00937e64a9 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:10.301535 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-be3cce4e-4add-408a-8183-c57a6bc9b452 req-968604e7-c13f-4156-96a4-5f00937e64a9 service nova] Creating event network-changed:146eaf31-f5ed-406c-bb33-c568119d87c0 for instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 on hv-cinder-84801 Jun 28 18:01:10.307161 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-be3cce4e-4add-408a-8183-c57a6bc9b452 req-968604e7-c13f-4156-96a4-5f00937e64a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037809 Jun 28 18:01:10.308142 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 548/1080] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 18:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 18:01:10.312640 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 18:01:10.399718 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0296506d-d219-4a16-a25b-cae553d96bc5 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 204 len: 0 microversion: 2.1 time: 0.133000 Jun 28 18:01:10.404723 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 533/1081] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 18:01:10 2022] DELETE /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 18:01:10.411413 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:10.412154 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:10.421797 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:10.422921 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:10.423794 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:10.424478 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:10.575604 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:10.583312 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-8f76f11a-aeec-4565-bf46-6d8990728960 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1575 microversion: 2.1 time: 0.176794 Jun 28 18:01:10.583864 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 549/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:10 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 18:01:11.605190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:11.605190 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:11.611590 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:11.612358 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:11.613463 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:11.614067 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:11.815287 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:11.825558 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-1a26778f-312e-4441-b2c4-4df49fadd242 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1575 microversion: 2.1 time: 0.227584 Jun 28 18:01:11.826202 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 534/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:11 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 18:01:12.612613 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-e5de7b44-1e8b-469f-bce1-b3288632c542 req-23e64bd7-484f-4bff-ab46-48c564e767c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1a2931-723f-4494-b4ee-1a03eb7a6011", "name": "network-vif-deleted", "tag": "146eaf31-f5ed-406c-bb33-c568119d87c0"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 18:01:12.624682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-e5de7b44-1e8b-469f-bce1-b3288632c542 req-23e64bd7-484f-4bff-ab46-48c564e767c3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:12.625114 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-e5de7b44-1e8b-469f-bce1-b3288632c542 req-23e64bd7-484f-4bff-ab46-48c564e767c3 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:12.640487 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] [61e9b215-2f23-475a-a697-3173d8576330] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47262. Jun 28 18:01:12.642783 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-e5de7b44-1e8b-469f-bce1-b3288632c542 req-23e64bd7-484f-4bff-ab46-48c564e767c3 service nova] Creating event network-vif-deleted:146eaf31-f5ed-406c-bb33-c568119d87c0 for instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 on hv-cinder-84801 Jun 28 18:01:12.648787 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-e5de7b44-1e8b-469f-bce1-b3288632c542 req-23e64bd7-484f-4bff-ab46-48c564e767c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039818 Jun 28 18:01:12.649400 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 550/1084] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 18:01:12.847522 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:12.848095 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:12.856340 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:12.856768 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:12.857543 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:12.857981 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:12.932873 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:12.941110 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-34b8e705-b3ff-4f08-b558-13e75a11095f tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 200 len: 1224 microversion: 2.1 time: 0.100092 Jun 28 18:01:12.941687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 535/1085] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:12 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 18:01:13.960639 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:13.961617 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 6b1a2931-723f-4494-b4ee-1a03eb7a6011] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:13.968741 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:13.969190 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:13.970011 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:13.970436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:13.986828 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] HTTP exception thrown: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Request method failure captured: Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 HTTP/1.1 Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0BkE4vU5IhVTdA_NIomLcSqf1N8Xhy4yHbZRKcDjEz0ho9c0bTvcCfBZp3LgRz8GXtAKznN-CQT0A6887LCtfn37wez2bOex-Leugm-90yF6z01PI1ilWIO_S1i69e8E9i6dVaQ1PHIKqT9zZvTohPH8zG3Z_t29MojDsvfvbQLcCc Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 18:01:13.988559 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}] Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 03f29e8a281f4a2ab15342314d6968d3 Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. Jun 28 18:01:13.990237 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '6b1a2931-723f-4494-b4ee-1a03eb7a6011'} Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 18:01:13.991050 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. Jun 28 18:01:13.993322 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:13.995283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Returning 404 to user: Instance 6b1a2931-723f-4494-b4ee-1a03eb7a6011 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 18:01:13.995283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-d6a6043b-a0f8-4cd7-a3cd-5cf3484982de tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011" status: 404 len: 111 microversion: 2.1 time: 0.034380 Jun 28 18:01:13.995283 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 551/1086] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:13 2022] GET /compute/v2.1/servers/6b1a2931-723f-4494-b4ee-1a03eb7a6011 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 18:01:17.174019 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:17.174596 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:17.175613 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-016a3168-3a60-47a6-9dd9-b887ceebdaa2 req-624dfc77-8a8a-4d45-b0cb-13e55626bc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2", "tag": "18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 18:01:17.181975 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:17.182512 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:17.183363 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:17.183856 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:17.185119 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-016a3168-3a60-47a6-9dd9-b887ceebdaa2 req-624dfc77-8a8a-4d45-b0cb-13e55626bc89 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:17.185625 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-016a3168-3a60-47a6-9dd9-b887ceebdaa2 req-624dfc77-8a8a-4d45-b0cb-13e55626bc89 service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:17.197598 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-016a3168-3a60-47a6-9dd9-b887ceebdaa2 req-624dfc77-8a8a-4d45-b0cb-13e55626bc89 service nova] Creating event network-changed:18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2 for instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 on hv-cinder-84801 Jun 28 18:01:17.203233 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-016a3168-3a60-47a6-9dd9-b887ceebdaa2 req-624dfc77-8a8a-4d45-b0cb-13e55626bc89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031542 Jun 28 18:01:17.203826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 552/1087] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 18:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 18:01:17.213025 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Going to try to terminate instance {{(pid=124337) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 18:01:17.308993 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-ef95119d-e45c-44fa-9121-845069066a24 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 204 len: 0 microversion: 2.1 time: 0.138633 Jun 28 18:01:17.309983 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 536/1088] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 18:01:17 2022] DELETE /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 18:01:17.319486 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:17.320192 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:17.330218 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:17.330895 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:17.332088 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:17.333123 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:17.504698 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.policy [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124336) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:17.513204 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-42c4d001-77af-4ed1-814e-67526be6d638 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1578 microversion: 2.1 time: 0.198383 Jun 28 18:01:17.513771 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 553/1089] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:17 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 18:01:18.532894 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:18.533710 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:18.541484 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:18.541989 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:18.542859 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:18.543283 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:18.691766 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:18.701395 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-0ab01127-c512-40c5-a828-e7c6cc3bae02 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1578 microversion: 2.1 time: 0.173213 Jun 28 18:01:18.701963 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 537/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:18 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 18:01:19.420181 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [req-b3d7abda-11b9-4dbc-ba96-e8ea82ae3256 req-c0d6d2ec-a2a2-451f-ae77-0201cb766bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2", "name": "network-vif-deleted", "tag": "18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2"}]} {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 18:01:19.429031 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b3d7abda-11b9-4dbc-ba96-e8ea82ae3256 req-c0d6d2ec-a2a2-451f-ae77-0201cb766bed service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:19.429471 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [req-b3d7abda-11b9-4dbc-ba96-e8ea82ae3256 req-c0d6d2ec-a2a2-451f-ae77-0201cb766bed service nova] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:19.442057 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.compute.server_external_events [req-b3d7abda-11b9-4dbc-ba96-e8ea82ae3256 req-c0d6d2ec-a2a2-451f-ae77-0201cb766bed service nova] Creating event network-vif-deleted:18e5d4c0-64d8-4bee-87e5-f6d8ad17c0f2 for instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 on hv-cinder-84801 Jun 28 18:01:19.447690 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [req-b3d7abda-11b9-4dbc-ba96-e8ea82ae3256 req-c0d6d2ec-a2a2-451f-ae77-0201cb766bed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Jun 28 18:01:19.448334 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 554/1091] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 28 18:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 18:01:19.718854 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:19.719672 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:19.728653 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:19.729148 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:19.730169 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:19.730818 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:19.799281 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.policy [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f29e8a281f4a2ab15342314d6968d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44949af40746b4af7f2acd60b73cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124337) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 18:01:19.807346 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-e78883e7-99b7-44d8-81f2-c3d78bc54c60 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 200 len: 1225 microversion: 2.1 time: 0.092754 Jun 28 18:01:19.808313 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 538/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:19 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 18:01:20.827054 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:20.827700 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:20.834752 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:20.835199 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:20.835958 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:20.836414 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:20.850902 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] HTTP exception thrown: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Request method failure captured: Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 HTTP/1.1 Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0BkE4vU5IhVTdA_NIomLcSqf1N8Xhy4yHbZRKcDjEz0ho9c0bTvcCfBZp3LgRz8GXtAKznN-CQT0A6887LCtfn37wez2bOex-Leugm-90yF6z01PI1ilWIO_S1i69e8E9i6dVaQ1PHIKqT9zZvTohPH8zG3Z_t29MojDsvfvbQLcCc Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 18:01:20.852636 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}] Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 03f29e8a281f4a2ab15342314d6968d3 Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. Jun 28 18:01:20.854288 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': 'e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2'} Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 18:01:20.855335 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. Jun 28 18:01:20.856722 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:20.857909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Returning 404 to user: Instance e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 18:01:20.857909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-a5be774e-0c4d-479f-81f5-a03cc134dada tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2" status: 404 len: 111 microversion: 2.1 time: 0.032478 Jun 28 18:01:20.857909 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 555/1093] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:20 2022] GET /compute/v2.1/servers/e19d0a6a-71b0-40eb-aaf8-8c2531c3d9b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 18:01:21.339372 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:21.339911 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.compute.api [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124337) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:21.346759 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:21.347214 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:21.347982 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:21.348441 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG oslo_concurrency.lockutils [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:21.362378 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.wsgi [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] HTTP exception thrown: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Request method failure captured: Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: request: DELETE /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a HTTP/1.1 Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept: application/json Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Accept-Encoding: identity Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Connection: close Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Length: 0 Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Content-Type: application/json Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Host: 10.222.0.43 Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Openstack-System-Scope: None Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: User-Agent: python-urllib3/1.26.9 Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Auth-Token: gAAAAABiu0BkE4vU5IhVTdA_NIomLcSqf1N8Xhy4yHbZRKcDjEz0ho9c0bTvcCfBZp3LgRz8GXtAKznN-CQT0A6887LCtfn37wez2bOex-Leugm-90yF6z01PI1ilWIO_S1i69e8E9i6dVaQ1PHIKqT9zZvTohPH8zG3Z_t29MojDsvfvbQLcCc Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Id: None Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Domain-Name: None Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Identity-Status: Confirmed Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Is-Admin-Project: True Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Id: default Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Domain-Name: Default Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Project-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Role: member,reader Jun 28 18:01:21.364114 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Roles: member,reader Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}] Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-Tenant-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Id: default Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Domain-Name: Default Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Id: 03f29e8a281f4a2ab15342314d6968d3 Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: X-User-Name: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: method: > Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: exception: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.365660 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: action_args: {'id': '8f4c2e92-aa2c-414a-b9b7-33bf3d22700a'} Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 18:01:21.366730 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.368349 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.370687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Returning 404 to user: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. {{(pid=124337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 18:01:21.370687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-8b317b13-59a2-4d43-803e-b3c19f82ea7e tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 404 len: 111 microversion: 2.1 time: 0.032929 Jun 28 18:01:21.370687 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 539/1094] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 28 18:01:21 2022] DELETE /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 18:01:21.374878 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '>' {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:21.375543 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.compute.api [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] [instance: 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a] Fetching instance by UUID {{(pid=124336) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 18:01:21.381874 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:21.382332 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:21.383106 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 18:01:21.383549 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG oslo_concurrency.lockutils [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Lock "565058e1-194e-4f59-84a2-1c095abe2191" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 18:01:21.398436 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.wsgi [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] HTTP exception thrown: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Request method failure captured: Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: request: GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a HTTP/1.1 Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept: application/json Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Accept-Encoding: identity Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Connection: close Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Length: 0 Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Content-Type: application/json Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Host: 10.222.0.43 Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Openstack-System-Scope: None Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: User-Agent: python-urllib3/1.26.9 Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Auth-Token: gAAAAABiu0BkE4vU5IhVTdA_NIomLcSqf1N8Xhy4yHbZRKcDjEz0ho9c0bTvcCfBZp3LgRz8GXtAKznN-CQT0A6887LCtfn37wez2bOex-Leugm-90yF6z01PI1ilWIO_S1i69e8E9i6dVaQ1PHIKqT9zZvTohPH8zG3Z_t29MojDsvfvbQLcCc Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Id: None Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Domain-Name: None Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Identity-Status: Confirmed Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Is-Admin-Project: True Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Id: default Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Domain-Name: Default Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Project-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Role: member,reader Jun 28 18:01:21.399990 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Roles: member,reader Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a44949af40746b4af7f2acd60b73cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a44949af40746b4af7f2acd60b73cba"}]}] Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Id: 8a44949af40746b4af7f2acd60b73cba Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-Tenant-Name: tempest-TestVolumeBootPattern-1975677613 Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Id: default Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Domain-Name: Default Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Id: 03f29e8a281f4a2ab15342314d6968d3 Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: X-User-Name: tempest-TestVolumeBootPattern-1975677613-project Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: method: > Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: exception: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.401979 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: action_args: {'id': '8f4c2e92-aa2c-414a-b9b7-33bf3d22700a'} Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: {{(pid=124336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 18:01:21.403083 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. Jun 28 18:01:21.404682 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: ERROR nova.api.openstack.wsgi Jun 28 18:01:21.406132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: DEBUG nova.api.openstack.wsgi [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Returning 404 to user: Instance 8f4c2e92-aa2c-414a-b9b7-33bf3d22700a could not be found. {{(pid=124336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 18:01:21.406132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO nova.api.openstack.requestlog [None req-0acd0657-4ba2-45dc-9a43-89d3435c0cf0 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a" status: 404 len: 111 microversion: 2.1 time: 0.030517 Jun 28 18:01:21.406132 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: [pid: 124336|app: 0|req: 556/1095] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 28 18:01:21 2022] GET /compute/v2.1/servers/8f4c2e92-aa2c-414a-b9b7-33bf3d22700a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 18:01:22.723616 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: DEBUG nova.api.openstack.wsgi [None req-b030cd88-2962-4c0d-b62c-a1b468d7bd09 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] Calling method '.version_select at 0x7f5772928280>' {{(pid=124337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 18:01:22.747355 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO nova.api.openstack.requestlog [None req-b030cd88-2962-4c0d-b62c-a1b468d7bd09 tempest-TestVolumeBootPattern-1975677613 tempest-TestVolumeBootPattern-1975677613-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-226535126" status: 202 len: 0 microversion: 2.1 time: 0.027651 Jun 28 18:01:22.747803 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: [pid: 124337|app: 0|req: 540/1096] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jun 28 18:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-226535126 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 18:01:27.449249 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:01:27.449826 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 18:01:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 18:01:36.582281 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:01:36.582838 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Tue Jun 28 18:01:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 18:03:18.678835 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:03:18.679632 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 18:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 18:04:47.459695 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:04:47.460691 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 18:04:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 18:04:56.592255 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:04:56.593201 dv-cinder-848013-1-iscsi devstack@n-api.service[124337]: Tue Jun 28 18:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 18:06:38.690105 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 18:06:38.691199 dv-cinder-848013-1-iscsi devstack@n-api.service[124336]: Tue Jun 28 18:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!